-- Logs begin at Tue 2022-08-09 15:24:22 UTC, end at Tue 2022-08-09 17:10:38 UTC. -- Aug 09 16:41:44.842083 dv-cinder-852364-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 16:41:44.849577 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 16:41:44 2022] *** Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: nodename: dv-cinder-852364-3-iscsi Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: machine: x86_64 Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: clock source: unix Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: pcre jit disabled Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: detected number of CPU cores: 4 Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: current working directory: / Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: detected binary path: /usr/bin/uwsgi-core Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: your processes number limit is 47680 Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: your memory page size is 4096 bytes Aug 09 16:41:44.853964 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: detected max file descriptor number: 2048 Aug 09 16:41:44.854726 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: lock engine: pthread robust mutexes Aug 09 16:41:44.854726 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: thunder lock: enabled Aug 09 16:41:44.854726 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 16:41:44.854726 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 16:41:44.894123 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: Python main interpreter initialized at 0x55b82bda69c0 Aug 09 16:41:44.894123 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: python threads support enabled Aug 09 16:41:44.894123 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: your server socket listen backlog is limited to 100 connections Aug 09 16:41:44.894123 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: your mercy for graceful operations on workers is 90 seconds Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: *** Operational MODE: preforking *** Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: *** uWSGI is running in multiple interpreter mode *** Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: spawned uWSGI master process (pid: 110383) Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: spawned uWSGI worker 1 (pid: 110384, cores: 1) Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: spawned uWSGI worker 2 (pid: 110385, cores: 1) Aug 09 16:41:44.899759 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 16:41:44.894989 dv-cinder-852364-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 16:41:45.572005 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 16:41:45.581813 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 16:41:46.675070 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:41:46.675070 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: from cryptography.utils import int_from_bytes Aug 09 16:41:46.675825 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:41:46.675825 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: from cryptography.utils import int_from_bytes Aug 09 16:41:46.675944 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:41:46.675944 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: from cryptography.utils import int_from_bytes Aug 09 16:41:46.676329 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:41:46.676329 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: from cryptography.utils import int_from_bytes Aug 09 16:41:49.236238 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:41:49.236816 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:41:49.237011 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:41:49.237371 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:41:49.237627 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:41:49.238016 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:41:49.238389 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.238482 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:41:49.238563 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.238648 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.238799 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:41:49.238964 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.239214 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:41:49.239305 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.239461 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:41:49.239625 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.239852 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.239968 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.240184 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.240283 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.240512 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.240604 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.240914 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.241410 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.241495 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.241568 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.241635 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-3-iscsi {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.241700 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.241895 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242015 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242209 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242315 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242524 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242631 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242845 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.242935 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.243176 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.243282 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.243504 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.243604 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-3-iscsi {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.243811 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.243898 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.244159 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.244308 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.244461 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.244758 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.244861 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.245071 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.245163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.245384 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.245485 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.245691 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.245781 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246026 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246195 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246338 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246507 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246817 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.246964 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.247275 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.247443 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.247540 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.247623 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.247794 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.247992 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-3-iscsi {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.248107 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.248309 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.248430 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.248620 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.248743 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.248937 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.249070 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.249350 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.249438 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.249665 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.249792 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-3-iscsi {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.249979 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.250066 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.250304 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.250401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.250640 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.250746 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.250954 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.251132 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.251311 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.251424 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.251636 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.251725 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.251967 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.252075 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.252291 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.252400 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.252597 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.252693 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.252909 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253012 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253218 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253315 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253538 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253635 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253846 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.253949 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.254154 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.254244 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.254407 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.254496 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.254718 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.254817 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255041 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255223 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255388 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255478 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255712 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255814 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.255966 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.256065 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.256220 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.256323 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.256587 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.256753 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257040 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257136 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257365 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257469 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257625 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257719 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257879 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.257967 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.258203 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.258302 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.258531 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.258618 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.258848 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.258940 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.259186 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.259276 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.259500 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.259589 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.259811 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.259896 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.260124 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.260217 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.260437 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.260534 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.260748 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.260841 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.261064 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.261164 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.261388 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.261480 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.261697 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.261795 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262009 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262107 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262322 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262411 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262647 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262748 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.262963 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.263052 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.263307 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.263412 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.263625 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.263727 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.263934 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264030 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264242 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264332 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264554 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264655 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264875 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.264966 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.265201 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.265291 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.265508 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.265609 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.265762 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.265853 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.266067 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.266163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.266373 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.266465 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.266694 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.266785 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267003 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267094 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267310 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267480 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267618 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267755 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.267916 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268059 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268278 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268428 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268564 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268699 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268835 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.268979 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269123 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269266 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269402 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269544 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269680 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269814 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.269991 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.270133 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.270300 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.270443 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.270607 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.270759 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.270917 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.271065 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.271253 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.271396 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.271564 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.271714 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.271855 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.272509 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.272699 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.272879 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273028 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273171 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273332 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273483 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273625 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273760 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.273938 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274090 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274253 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274402 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274551 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274702 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274839 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.274983 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.275178 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.275333 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.275475 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.275617 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.275789 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.275950 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.276093 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.276229 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.276398 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.276549 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.276695 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.276845 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277012 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277154 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277320 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277461 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277626 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277780 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.277923 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278059 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278224 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278375 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278524 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278671 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278805 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.278948 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.279096 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.279265 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.279414 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.279550 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.279714 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.279863 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280035 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280178 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280327 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280464 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280638 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280780 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.280946 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.281097 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.281242 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.281382 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.281557 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.281709 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.281879 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.282033 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.282193 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.282335 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.282506 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.282648 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.282815 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.282971 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.283142 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:41:49.283286 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.283488 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.283639 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.283824 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.283977 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.284140 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.284282 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.284458 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.284613 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.284787 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.284943 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.285101 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.285244 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.285416 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.285559 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.285729 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.285879 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286047 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286188 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286367 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286525 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286672 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286813 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.286984 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.287183 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.287350 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.287501 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.287706 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.288833 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.288992 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289139 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289139 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289408 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289569 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289707 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289844 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.289987 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.290129 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.290266 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.290475 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.290615 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.290615 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.290879 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291016 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291197 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291342 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291488 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291624 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291760 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.291897 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292044 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292180 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292317 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292452 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292588 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292723 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.292868 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293036 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293198 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293357 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293499 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293683 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293835 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.293998 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.294149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.294312 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.294465 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.294627 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.294779 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.294946 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.295090 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.295300 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.295437 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.295615 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.295760 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.295935 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.296079 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.296255 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.296398 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.296572 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.296715 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.296892 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297035 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297208 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297361 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297506 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297642 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297823 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.297966 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.298132 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.298289 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.298435 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.298572 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.298732 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.298881 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.299044 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.299230 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.299395 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.299546 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.299695 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.299838 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300002 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300161 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300315 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300458 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300600 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300740 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.300915 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301079 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301223 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301383 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301527 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301669 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301810 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.301961 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.302110 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.302269 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.302426 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.302571 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.302727 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.302871 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.303021 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.303226 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.303432 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304042 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304216 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304363 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304507 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304650 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304800 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.304945 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305095 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305239 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305380 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305380 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305814 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.305966 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306117 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306260 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306402 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306545 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306701 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306847 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.306989 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.307166 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.307581 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.307726 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.307888 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308044 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308194 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308344 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308486 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308640 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308796 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.308946 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309098 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309242 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309384 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309687 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309831 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.309973 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310127 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310277 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310429 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310570 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310712 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310854 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.310996 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.311161 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.311322 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.311465 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.311625 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.311768 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.311911 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312052 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312202 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312351 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312493 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312642 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312785 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.312927 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313081 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313223 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313365 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313520 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313670 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313821 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.313964 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314105 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314247 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314395 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314544 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314694 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314838 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.314980 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.315160 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.315310 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.315463 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.315617 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.315760 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.315901 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316043 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316184 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316326 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316476 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316627 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316770 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.316941 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.317092 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.317286 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.317447 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.317625 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.317775 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.317950 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.318102 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.318254 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.318395 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.318566 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.318715 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.318914 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.319152 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.319392 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.319548 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.319548 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.319828 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.319970 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320118 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320270 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320412 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320563 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320704 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320845 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.320987 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.321138 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.321281 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.321441 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.321584 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.321726 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.321880 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322023 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322164 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322307 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322457 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322599 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322750 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.322894 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.323035 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.323260 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.323425 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.323569 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.323726 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.323869 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324024 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324168 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324310 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324484 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324647 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324790 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.324941 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.325083 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.325225 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.325391 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.325536 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.325708 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.325864 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326029 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326176 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326327 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326475 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326626 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326769 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.326946 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.327095 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.327283 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.327444 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.327590 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.327732 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.327900 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.328049 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.328223 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.328423 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.328580 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.328724 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.328874 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329018 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329173 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329327 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329476 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329621 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329763 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.329917 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330060 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330202 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330343 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330486 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330626 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330783 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.330926 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331068 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331263 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331559 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331711 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331854 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.331996 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332137 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332279 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332421 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332571 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332714 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332857 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.332999 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.333151 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.333302 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.333452 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.333593 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.333735 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.333910 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.334060 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.334220 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.334370 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.335028 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.335275 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.335872 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336020 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336189 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336334 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336484 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336627 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336768 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.336909 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337085 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337231 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337374 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337517 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337658 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337818 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.337962 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338124 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338275 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338419 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338713 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338856 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.338998 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.339169 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.339342 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.339491 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.339651 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.339796 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.339953 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340095 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340237 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340378 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340528 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340670 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340818 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.340961 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.341102 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.341253 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.341396 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.341565 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.341754 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.341911 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342054 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342205 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342358 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342501 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342643 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342792 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.342935 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.343085 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.343280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.343425 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.343567 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.343717 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.343870 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344021 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344164 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344164 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344443 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344587 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344741 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.344883 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345025 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345166 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345308 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345458 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345614 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345777 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.345919 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.346061 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.346211 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.346361 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.346511 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.346696 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.346888 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347051 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347233 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347378 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347529 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347695 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347849 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.347992 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.348134 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.348277 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.348427 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.348584 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.348728 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.348875 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349022 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349173 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349325 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349475 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349637 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349781 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.349924 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.350073 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.350806 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.350960 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.351167 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.351329 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.351474 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.351633 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.351781 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.351948 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352099 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352253 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352405 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352548 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352692 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352844 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.352986 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.353129 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.353271 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.353421 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.353564 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.353715 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.353859 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354002 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354154 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354297 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354439 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354595 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354738 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.354883 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355025 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355193 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355351 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355503 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355653 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355796 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.355949 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356099 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356250 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356394 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356543 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356686 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356828 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.356972 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.357122 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.357267 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.357409 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.357591 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.357741 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.357937 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358101 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358253 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358394 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358536 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358677 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358843 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.358988 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.359189 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.359349 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.359492 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.359634 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.359786 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.359941 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360092 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360235 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360375 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360686 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360830 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.360973 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.361124 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.361279 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.361422 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.361572 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.361726 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.361876 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362025 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362168 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362319 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362461 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362612 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362755 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.362897 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363038 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363221 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363368 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363510 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363662 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363813 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.363955 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364106 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364250 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364392 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364533 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364675 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364817 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.364967 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.365117 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.365261 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.365403 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.365556 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.365712 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.366352 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.366516 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.366671 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.366671 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.366950 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.367199 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.367352 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.367498 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.367640 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.367783 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.367925 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368091 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368234 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368383 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368534 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368678 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368826 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.368989 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.369136 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.369277 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.369460 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.369605 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.369760 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.369904 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370060 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370203 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370345 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370487 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370639 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370782 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370925 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.370925 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.371305 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.371452 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.371606 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.371749 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.371909 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.371909 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.372181 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.372323 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.372541 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.372688 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.372830 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.372830 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373107 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373107 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373385 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373536 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373680 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373840 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.373990 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.374147 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.374290 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.374433 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.374581 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.374725 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.374877 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375029 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375223 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375368 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375511 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375653 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375818 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.375975 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376129 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376272 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376421 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376564 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376724 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376724 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.376919 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377004 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377101 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377184 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377274 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377355 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377434 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377512 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377590 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377824 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.377936 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.378135 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.378234 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.378456 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.378569 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.378772 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.378881 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.379087 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.379205 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.379414 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.379501 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.379722 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.379825 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380029 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380115 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380334 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380421 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380643 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380738 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.380952 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.381040 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.381264 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.381350 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.381622 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.381781 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.381937 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382065 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382239 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382337 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382550 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382638 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382856 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.382950 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.383188 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.383280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.383501 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.383591 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.383810 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.383911 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.384133 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.384232 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.384444 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.384539 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.384749 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.384836 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385056 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385158 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385361 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385449 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385669 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385764 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.385972 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.386071 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.386284 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.386400 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.386595 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.386723 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.386924 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.387089 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.387291 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.387438 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.387581 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.387722 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.387874 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388025 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388175 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388317 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388467 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388610 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388761 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.388944 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.389163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.389314 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.389485 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.389635 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.389787 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.389929 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.390099 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.390248 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.390414 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.390572 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.390729 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.390871 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391021 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391206 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391353 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391507 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391651 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391792 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.391979 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.392127 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.392277 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.392433 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.392624 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.392774 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.392916 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.393058 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.393239 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.393398 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.393646 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.393796 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.393940 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.394080 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.394247 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.394404 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.394578 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.394726 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.394891 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.395039 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.395229 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.395384 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.395550 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.395728 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.395879 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.396022 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.396217 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.396366 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.396508 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.396673 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.396824 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.397517 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.397771 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.397976 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.398247 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.398401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.398547 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.398699 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.398870 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399023 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399235 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399384 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399528 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399528 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399843 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.399935 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400028 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400110 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400196 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400415 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400506 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400727 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.400817 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.401058 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.401147 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.401385 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.401474 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.401701 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.401790 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402021 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402109 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402330 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402418 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402639 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402726 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.402949 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.403037 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.403281 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.403385 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.403591 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.403680 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.403919 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404077 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404221 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404528 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404672 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404823 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.404967 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.405117 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.405270 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.405414 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.405557 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.405712 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.405866 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406008 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406161 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406305 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406448 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406613 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406762 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.406919 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.407070 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.407391 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.407567 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.407718 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.407883 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408029 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408171 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408315 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408488 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408645 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408802 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.408946 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.409095 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.409239 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.409383 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.409525 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.409715 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.409877 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410020 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410162 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410333 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410483 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410667 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410818 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.410998 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.411179 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.411337 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.411530 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.411682 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.411838 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.411982 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.412122 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.412264 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.412419 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.412570 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.413478 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.413683 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.413836 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.413980 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.414132 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.414132 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.414405 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.414559 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.414709 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.414861 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415005 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415193 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415353 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415497 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415641 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415793 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.415937 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416079 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416221 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416362 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416515 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416667 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416811 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.416961 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417104 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417246 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417397 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417548 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417692 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417836 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.417987 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.418130 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.418299 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.418443 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.418585 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.418727 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.418880 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419023 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419264 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419412 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419563 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419707 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419850 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.419993 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.420145 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.420299 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.420450 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.420593 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.420743 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.420895 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421047 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421190 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421340 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421483 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421633 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421788 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.421932 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422083 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422245 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422397 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422539 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422690 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422835 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.422986 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.423163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.423323 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.423466 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.423618 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.423762 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.423904 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424054 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424208 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424359 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424513 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424656 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424799 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.424941 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.425122 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.425282 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.425433 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.425576 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.425742 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.425900 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.426054 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.426281 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.426433 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.426577 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.426719 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.426862 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.427004 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.427229 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.427382 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.427570 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.427719 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.427893 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.428043 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.428206 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.428989 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.428989 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.429296 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.429442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.429595 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.429740 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.429891 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430034 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430177 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430177 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430457 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430618 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430768 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.430912 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.431062 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.431062 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.431462 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.431462 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.431740 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.431891 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.432035 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.432445 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.432596 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.432750 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.432901 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433044 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433187 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433340 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433485 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433485 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433763 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.433907 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434064 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434211 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434366 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434511 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434662 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434806 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.434958 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.435132 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.435283 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.435426 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.435570 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.435724 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.435868 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.436290 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.436457 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.436615 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.436759 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.436759 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437039 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437182 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437343 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437488 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437640 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437792 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.437944 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438095 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438238 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438392 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438544 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438689 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438832 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.438975 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.439149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.439300 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.439459 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.439604 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.439747 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.439890 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440032 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440032 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440327 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440471 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440615 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440764 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.440909 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441052 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441204 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441347 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441498 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441641 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441783 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.441940 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442084 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442237 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442378 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442529 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442672 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.442981 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.443153 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.443303 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.443457 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.443601 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.443753 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.443951 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.444463 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.444626 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.444772 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.444924 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445083 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445235 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445379 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445521 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445822 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.445822 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.446105 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.446249 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.446403 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.446546 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.446702 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.446896 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.447040 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.447272 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.447419 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.447571 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.447724 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.447868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448025 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448169 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448465 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448618 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448761 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.448904 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449054 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449212 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449369 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449513 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449655 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449798 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.449940 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.450111 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.450276 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.450428 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.450571 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.450720 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.450863 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451006 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451179 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451331 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451474 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451616 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451759 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.451902 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452054 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452361 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452505 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452655 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452813 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.452956 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453099 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453240 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453383 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453526 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453677 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453827 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.453970 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.454122 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.454265 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.454421 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.454574 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.454718 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.454860 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.455002 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.455174 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.455324 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.455548 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.455701 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.455853 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.456177 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.456331 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.456483 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.456627 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.456627 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.456906 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.457056 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.457212 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.457357 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.457895 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.458047 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.458390 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.458544 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.458715 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.458868 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.459011 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.459183 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.459330 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.460014 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.460293 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.460909 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461068 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461068 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461353 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461506 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461663 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461828 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.461828 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462100 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462243 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462396 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462539 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462682 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462826 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.462969 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.463178 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.463342 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.463487 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.463642 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.463797 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.463943 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464085 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464238 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464389 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464540 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464683 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464826 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.464983 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.465130 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.465273 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.465426 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.465568 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.465732 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.465884 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466029 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466171 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466324 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466468 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466610 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466762 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.466906 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467050 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467226 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467327 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467439 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467554 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467642 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467724 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467805 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467885 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.467974 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468057 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468138 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468219 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468306 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468387 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468476 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468557 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468650 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468773 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.468929 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.469081 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.469235 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.469404 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.469554 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.469698 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.469841 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470022 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470186 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470338 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470482 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470632 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470787 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.470939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.471091 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.471266 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.471410 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.471595 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.471757 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.471934 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.472095 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.472247 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.472418 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.472569 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.472721 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.472865 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473048 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473199 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473376 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473525 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473678 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473829 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.473983 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.474134 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.474314 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.474474 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.474626 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.474770 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.474941 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.475719 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.476271 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.476445 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.476601 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.476744 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.476888 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477042 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477186 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477343 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477343 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477618 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477761 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.477903 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478053 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478206 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478350 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478493 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478646 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478789 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.478952 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479096 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479264 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479408 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479551 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479695 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479854 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.479998 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.480141 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.480284 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.480435 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.480579 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.480747 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.480900 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481054 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481199 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481343 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481494 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481647 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481801 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.481946 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482089 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482240 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482392 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482535 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482689 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482689 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.482976 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.483180 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.483343 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.483496 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.483640 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.483784 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.483926 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484068 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484219 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484371 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484514 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484676 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484820 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.484962 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.485178 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.485332 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.485475 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.485625 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.485768 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.485928 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.486072 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.486223 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.486417 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.486570 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.486732 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.486889 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487034 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487202 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487346 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487489 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487631 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487791 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.487935 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488079 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488220 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488364 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488535 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488681 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488823 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.488973 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489117 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489261 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489411 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489556 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489699 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489849 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.489993 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.490137 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.490301 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.490446 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.490590 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.490769 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.491381 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.491543 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.491695 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.491695 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.491976 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.492127 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.492272 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.492428 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.492574 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.492736 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.492888 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493039 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493191 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493345 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493489 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493632 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493776 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493871 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.493953 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494049 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494133 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494213 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494293 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494374 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494468 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494609 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494754 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.494954 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.495075 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.495310 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.495451 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.495629 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.495771 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.495944 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.496089 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.496253 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.496430 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.496635 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:41:49.496781 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.497138 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.497480 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.497798 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.498131 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.498464 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.498817 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.499157 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.499509 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.499850 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.500173 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.500492 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.500805 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:41:49.501053 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:41:49.651832 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO dbcounter [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Registered counter for database nova_api Aug 09 16:41:49.655902 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO dbcounter [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Registered counter for database nova_api Aug 09 16:41:49.672531 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_db.sqlalchemy.engines [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.675269 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_db.sqlalchemy.engines [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.679463 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writer thread running {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.682579 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writer thread running {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.735016 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.context [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795ddccc-4e3b-400c-a74d-b466147e7ecd(cell1) {{(pid=110385) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 16:41:49.738374 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.context [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795ddccc-4e3b-400c-a74d-b466147e7ecd(cell1) {{(pid=110384) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 16:41:49.738882 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:41:49.739378 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:41:49.741022 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:41:49.741830 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:41:49.742199 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_concurrency.lockutils [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:41:49.742368 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:41:49.742675 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_concurrency.lockutils [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:41:49.744266 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:41:49.744377 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_concurrency.lockutils [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:41:49.745005 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_concurrency.lockutils [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:41:49.745453 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_concurrency.lockutils [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:41:49.746258 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO dbcounter [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Registered counter for database nova_cell0 Aug 09 16:41:49.747457 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_concurrency.lockutils [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110384) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:41:49.749460 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO dbcounter [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Registered counter for database nova_cell0 Aug 09 16:41:49.751677 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO dbcounter [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Registered counter for database nova_cell1 Aug 09 16:41:49.755057 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO dbcounter [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Registered counter for database nova_cell1 Aug 09 16:41:49.760051 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_db.sqlalchemy.engines [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.761592 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_db.sqlalchemy.engines [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.763693 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_db.sqlalchemy.engines [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.765321 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_db.sqlalchemy.engines [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.767835 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writer thread running {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.770660 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writer thread running {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.771242 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writer thread running {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.774306 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writer thread running {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.915189 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO dbcounter [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Registered counter for database nova_cell0 Aug 09 16:41:49.918949 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO dbcounter [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Registered counter for database nova_cell0 Aug 09 16:41:49.924534 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_db.sqlalchemy.engines [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.928076 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG oslo_db.sqlalchemy.engines [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:41:49.929671 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writer thread running {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:49.933498 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writer thread running {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:41:50.385844 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: WARNING keystonemiddleware.auth_token [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:41:50.393287 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: WARNING keystonemiddleware.auth_token [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:41:50.403177 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: WARNING keystonemiddleware.auth_token [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:41:50.410389 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: WARNING keystonemiddleware.auth_token [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:41:50.747321 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: WARNING keystonemiddleware.auth_token [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:41:50.753162 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: WARNING keystonemiddleware.auth_token [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:41:50.753277 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: WARNING keystonemiddleware.auth_token [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:41:50.759483 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b82bda69c0 pid: 110385 (default app) Aug 09 16:41:50.759746 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: WARNING keystonemiddleware.auth_token [None req-14712ac6-9e8b-4902-87e5-2a788425fd59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:41:50.761558 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:41:50.762717 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001719 Aug 09 16:41:50.764803 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Tue Aug 9 16:41:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:41:50.764983 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b82bda69c0 pid: 110384 (default app) Aug 09 16:43:10.563028 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:10.565020 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002530 Aug 09 16:43:10.565817 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:10.577757 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writing DB stats nova_api:SELECT=3 {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:10.578992 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writing DB stats nova_cell0:SELECT=3 {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:10.580114 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writing DB stats nova_cell1:SELECT=3 {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:10.581232 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:11.456281 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-97da0a4b-fdff-4de6-918b-817241165d20 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:11.487902 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-97da0a4b-fdff-4de6-918b-817241165d20 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915493 Aug 09 16:43:11.488435 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 16:43:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:13.747043 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:13.748631 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-461711a0-1d98-4a3f-b0d8-76762e6b8800 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Aug 09 16:43:13.749287 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:14.284280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-83abb43a-c0b3-402e-8e90-1eff5abc1774 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "name": "cirros256"}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:14.306489 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:43:14.306489 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: warnings.warn(msg) Aug 09 16:43:14.391539 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-83abb43a-c0b3-402e-8e90-1eff5abc1774 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.634737 Aug 09 16:43:14.392092 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:14.405971 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_api:SELECT=3 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:14.406930 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_cell1:SELECT=3 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:14.408127 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_cell0:SELECT=3 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:14.409053 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:14.638117 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-cb62088f-2543-4f73-879a-e3f4f992f324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:14.716523 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:43:14.716523 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: warnings.warn(msg) Aug 09 16:43:14.837287 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-cb62088f-2543-4f73-879a-e3f4f992f324 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.436581 Aug 09 16:43:14.859140 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 16:43:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:17.113801 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-83abb43a-c0b3-402e-8e90-1eff5abc1774 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:17.114839 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-83abb43a-c0b3-402e-8e90-1eff5abc1774 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 09 16:43:17.115416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:17.789661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-a910d0c7-4d8c-41ab-92ba-bf7aac8d9605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:17.809473 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:43:17.809473 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: warnings.warn(msg) Aug 09 16:43:17.891879 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-a910d0c7-4d8c-41ab-92ba-bf7aac8d9605 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.769975 Aug 09 16:43:17.892671 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:43:17.906129 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-1acb5090-71a3-465a-8a98-ebc0ce095764 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:17.909436 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:43:17.909436 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: warnings.warn(msg) Aug 09 16:43:18.015459 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-1acb5090-71a3-465a-8a98-ebc0ce095764 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112854 Aug 09 16:43:18.016137 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 16:43:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:20.269693 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-a910d0c7-4d8c-41ab-92ba-bf7aac8d9605 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:20.271221 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-a910d0c7-4d8c-41ab-92ba-bf7aac8d9605 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 Aug 09 16:43:20.271791 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:20.684274 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-140da0a3-0692-45e7-9c18-d017e8d2013b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:20.775607 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-140da0a3-0692-45e7-9c18-d017e8d2013b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497443 Aug 09 16:43:20.776308 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:20.788348 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-92fd5678-d6cb-47ea-868d-c880413119c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:20.853267 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-92fd5678-d6cb-47ea-868d-c880413119c0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068716 Aug 09 16:43:20.853845 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 16:43:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:23.085856 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-140da0a3-0692-45e7-9c18-d017e8d2013b admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:23.087513 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-140da0a3-0692-45e7-9c18-d017e8d2013b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Aug 09 16:43:23.088407 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:23.534161 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-860ece1c-845c-487a-b3dc-6ee31b7a4db4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:23.620377 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-860ece1c-845c-487a-b3dc-6ee31b7a4db4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524453 Aug 09 16:43:23.621597 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:23.634421 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-9589e7f9-6f7e-4f8f-80f9-965d932e80ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:23.717079 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-9589e7f9-6f7e-4f8f-80f9-965d932e80ff admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086889 Aug 09 16:43:23.718113 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 16:43:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:26.085395 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-860ece1c-845c-487a-b3dc-6ee31b7a4db4 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:26.086438 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-860ece1c-845c-487a-b3dc-6ee31b7a4db4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 09 16:43:26.087145 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:43:26.516294 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-5492e3b5-04b9-4cfb-b7f0-1be847e93169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:26.576553 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-5492e3b5-04b9-4cfb-b7f0-1be847e93169 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483528 Aug 09 16:43:26.577137 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:26.590009 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-e5a45554-9805-484b-8a90-9cfd6e6579fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:26.648175 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-e5a45554-9805-484b-8a90-9cfd6e6579fb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061830 Aug 09 16:43:26.649111 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 9 16:43:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:28.926367 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-5492e3b5-04b9-4cfb-b7f0-1be847e93169 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:28.927669 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-5492e3b5-04b9-4cfb-b7f0-1be847e93169 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Aug 09 16:43:28.928070 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:29.358440 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-faece18e-f4d8-4a0b-8118-c2e71de43876 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:29.384233 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-faece18e-f4d8-4a0b-8118-c2e71de43876 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449425 Aug 09 16:43:29.384776 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 16:43:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:43:31.633392 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-5492e3b5-04b9-4cfb-b7f0-1be847e93169 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:31.634402 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-5492e3b5-04b9-4cfb-b7f0-1be847e93169 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 09 16:43:31.634824 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:43:32.085497 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-4fa1fbf5-8e4e-41db-bc4b-d418f97e2f44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "id": "1", "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:32.164758 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-4fa1fbf5-8e4e-41db-bc4b-d418f97e2f44 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.523598 Aug 09 16:43:32.165331 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:32.177739 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-f4e4de01-fa0f-41e5-bc26-c9f294a6d434 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:32.254514 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-f4e4de01-fa0f-41e5-bc26-c9f294a6d434 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080492 Aug 09 16:43:32.255726 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 16:43:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:34.554701 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-4fa1fbf5-8e4e-41db-bc4b-d418f97e2f44 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:34.555784 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-4fa1fbf5-8e4e-41db-bc4b-d418f97e2f44 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 09 16:43:34.556423 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:34.960394 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-b2460bb6-afc0-4502-885f-3e772e9c2aff admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:35.061998 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-b2460bb6-afc0-4502-885f-3e772e9c2aff admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.499356 Aug 09 16:43:35.062555 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:35.076048 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-7525372d-72d6-437e-958b-eee08fe193eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:35.180606 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-7525372d-72d6-437e-958b-eee08fe193eb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108471 Aug 09 16:43:35.181180 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 16:43:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:37.413674 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-b2460bb6-afc0-4502-885f-3e772e9c2aff admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:37.414744 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-b2460bb6-afc0-4502-885f-3e772e9c2aff admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 09 16:43:37.415366 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:37.838150 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-5ce3a1a7-f1db-4701-a00a-a889a5563578 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "swap": 0, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:37.930297 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-5ce3a1a7-f1db-4701-a00a-a889a5563578 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.509118 Aug 09 16:43:37.930860 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:37.943938 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-d30a2f00-f9f6-4bf2-9eec-f6024000dc78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:38.054499 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-d30a2f00-f9f6-4bf2-9eec-f6024000dc78 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114906 Aug 09 16:43:38.055013 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 16:43:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:40.337033 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-5ce3a1a7-f1db-4701-a00a-a889a5563578 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:40.340809 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-5ce3a1a7-f1db-4701-a00a-a889a5563578 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003726 Aug 09 16:43:40.341495 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:40.847499 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-2bb0ff0d-5aa1-496f-8f68-d390c847bee3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 80}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:40.854408 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:41.559764 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-2bb0ff0d-5aa1-496f-8f68-d390c847bee3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.208340 Aug 09 16:43:41.560542 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:41.573002 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-a532bdb0-aff3-4161-aecb-6f4e5fc8aa99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:41.728894 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-a532bdb0-aff3-4161-aecb-6f4e5fc8aa99 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159612 Aug 09 16:43:41.729522 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 16:43:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:43:44.010241 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-2bb0ff0d-5aa1-496f-8f68-d390c847bee3 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:43:44.011984 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-2bb0ff0d-5aa1-496f-8f68-d390c847bee3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Aug 09 16:43:44.015183 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:43:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:43:44.476409 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-325d99f4-976a-4eaf-8003-edd2e69d689c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:44.553105 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-325d99f4-976a-4eaf-8003-edd2e69d689c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.534640 Aug 09 16:43:44.553837 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 9 16:43:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:43:44.566289 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-49f04eb2-3a2b-4de9-a113-308e88e36fff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:43:44.647861 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-49f04eb2-3a2b-4de9-a113-308e88e36fff admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085161 Aug 09 16:43:44.648638 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 9 16:43:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:44:04.773199 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-325d99f4-976a-4eaf-8003-edd2e69d689c admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:04.774212 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-325d99f4-976a-4eaf-8003-edd2e69d689c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 09 16:44:04.774802 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:05.184586 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-d500aac7-3952-4056-baba-9449e7cb88af admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:05.203028 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-d500aac7-3952-4056-baba-9449e7cb88af admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.421980 Aug 09 16:44:05.203588 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 16:44:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:44:06.299995 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-325d99f4-976a-4eaf-8003-edd2e69d689c admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:06.301029 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-325d99f4-976a-4eaf-8003-edd2e69d689c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 09 16:44:06.301423 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:06.839852 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-49c5a775-a814-45d4-8124-45596120f93c admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:06.839852 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.wsgi [None req-49c5a775-a814-45d4-8124-45596120f93c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-49c5a775-a814-45d4-8124-45596120f93c admin admin] Request method failure captured: Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Accept: application/json Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Accept-Encoding: gzip, deflate Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Connection: keep-alive Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Content-Length: 0 Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Host: 10.222.0.59 Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Openstack-Api-Version: compute 2.90 Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Openstack-System-Scope: None Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: User-Agent: python-novaclient Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Auth-Token: gAAAAABi8o7W1uRLX2Ru5b80RWgiV9RCfLFx6CpZIPxVd8jyXIhaFpid8JRnoa6ZW_3AMXodmz6kizhI755CnTrAFlX4I_qb_BoBmwvjdTe0kJHzQE2VDPufNGZUBKnpbHQs4G6cB-SMH7M0wMFchorxLM2qBB4HUCJY_S3OZyoOI1wThdGSG_w Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Domain-Id: None Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Domain-Name: None Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Identity-Status: Confirmed Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Is-Admin-Project: True Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Domain-Id: default Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Domain-Name: Default Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Name: admin Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Role: member,admin,reader Aug 09 16:44:06.842828 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Roles: member,admin,reader Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_71a0f1acc61b45eba6ed6a5653958267", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}] Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant: admin Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant-Name: admin Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User: admin Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Domain-Id: default Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Domain-Name: Default Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Id: ca7d3603df364f0b9021187b3d134f71 Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Name: admin Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: method: > Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: exception: Flavor 42 could not be found. Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: action_args: {'id': '42'} Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:44:06.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:06.846373 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.848216 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-49c5a775-a814-45d4-8124-45596120f93c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:44:06.850710 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-49c5a775-a814-45d4-8124-45596120f93c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403851 Aug 09 16:44:06.850710 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 16:44:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:06.854576 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-fb337112-d286-4fb9-9b8e-7aae57d86bd2 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:06.859341 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:06.881051 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-fb337112-d286-4fb9-9b8e-7aae57d86bd2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029929 Aug 09 16:44:06.881631 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 16:44:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:44:06.891945 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-161261b6-b64d-4914-ae8e-075961d6c483 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:06.919295 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-161261b6-b64d-4914-ae8e-075961d6c483 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030933 Aug 09 16:44:06.919964 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 16:44:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:44:06.931765 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-436b59aa-3110-4792-823f-027ccfc50706 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:06.937492 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.wsgi [None req-436b59aa-3110-4792-823f-027ccfc50706 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-436b59aa-3110-4792-823f-027ccfc50706 admin admin] Request method failure captured: Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Accept: application/json Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Accept-Encoding: gzip, deflate Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Connection: keep-alive Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Content-Length: 0 Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Host: 10.222.0.59 Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Openstack-Api-Version: compute 2.90 Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Openstack-System-Scope: None Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: User-Agent: python-novaclient Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Auth-Token: gAAAAABi8o7W1uRLX2Ru5b80RWgiV9RCfLFx6CpZIPxVd8jyXIhaFpid8JRnoa6ZW_3AMXodmz6kizhI755CnTrAFlX4I_qb_BoBmwvjdTe0kJHzQE2VDPufNGZUBKnpbHQs4G6cB-SMH7M0wMFchorxLM2qBB4HUCJY_S3OZyoOI1wThdGSG_w Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Domain-Id: None Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Domain-Name: None Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Identity-Status: Confirmed Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Is-Admin-Project: True Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Domain-Id: default Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Domain-Name: Default Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Name: admin Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Role: member,admin,reader Aug 09 16:44:06.940785 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Roles: member,admin,reader Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_71a0f1acc61b45eba6ed6a5653958267", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}] Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant: admin Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant-Name: admin Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User: admin Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Domain-Id: default Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Domain-Name: Default Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Id: ca7d3603df364f0b9021187b3d134f71 Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Name: admin Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: method: > Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: exception: Flavor 42 could not be found. Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: action_args: {'id': '42'} Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:44:06.942340 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:06.947987 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:06.949149 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-436b59aa-3110-4792-823f-027ccfc50706 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:44:06.950119 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-436b59aa-3110-4792-823f-027ccfc50706 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015160 Aug 09 16:44:06.950119 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 16:44:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 16:44:07.924186 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-161261b6-b64d-4914-ae8e-075961d6c483 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:07.925238 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-161261b6-b64d-4914-ae8e-075961d6c483 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 09 16:44:07.925630 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:08.592053 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-c6a94cdc-6c65-484a-85d6-142d00721fa8 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:08.597350 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.wsgi [None req-c6a94cdc-6c65-484a-85d6-142d00721fa8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-c6a94cdc-6c65-484a-85d6-142d00721fa8 admin admin] Request method failure captured: Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Accept: application/json Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Accept-Encoding: gzip, deflate Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Connection: keep-alive Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Content-Length: 0 Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Host: 10.222.0.59 Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Openstack-Api-Version: compute 2.90 Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Openstack-System-Scope: None Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: User-Agent: python-novaclient Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Auth-Token: gAAAAABi8o7XQOATA1lSNL1wiS5YfSKdcDEHjApaHEKNPaMLzrjCJhhWimXQu9pNqHOwT60HySDKTUJQt_GcEDMH4c9-uZdDQMgy_JQtch5JTeGSa11qHHOVVwBgDwxqIT6LazxIbYtodKGWuOJ3owAQBUDtG-VNYWPxTAJph8gZtsfPMmW4doE Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Domain-Id: None Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Domain-Name: None Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Identity-Status: Confirmed Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Is-Admin-Project: True Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Domain-Id: default Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Domain-Name: Default Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Name: admin Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Role: member,admin,reader Aug 09 16:44:08.598868 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Roles: member,admin,reader Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_71a0f1acc61b45eba6ed6a5653958267", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}] Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant: admin Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant-Name: admin Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User: admin Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Domain-Id: default Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Domain-Name: Default Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Id: ca7d3603df364f0b9021187b3d134f71 Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Name: admin Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: method: > Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: exception: Flavor 84 could not be found. Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: action_args: {'id': '84'} Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:44:08.600561 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:08.601661 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.603046 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-c6a94cdc-6c65-484a-85d6-142d00721fa8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:44:08.604316 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-c6a94cdc-6c65-484a-85d6-142d00721fa8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.519681 Aug 09 16:44:08.604316 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 16:44:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:08.610126 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-402d30ed-c577-4c56-a8ad-36134738df06 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:08.625477 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-402d30ed-c577-4c56-a8ad-36134738df06 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018998 Aug 09 16:44:08.626013 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 16:44:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:44:08.636352 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-1064359d-8a68-4cf5-a05e-acb348c21ec1 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:08.651228 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-1064359d-8a68-4cf5-a05e-acb348c21ec1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018384 Aug 09 16:44:08.651752 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 16:44:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:44:08.661202 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-2b055cc2-e2ac-4638-8263-b43b15ae2e00 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:08.666692 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.wsgi [None req-2b055cc2-e2ac-4638-8263-b43b15ae2e00 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-2b055cc2-e2ac-4638-8263-b43b15ae2e00 admin admin] Request method failure captured: Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Accept: application/json Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Accept-Encoding: gzip, deflate Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Connection: keep-alive Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Content-Length: 0 Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Host: 10.222.0.59 Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Openstack-Api-Version: compute 2.90 Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Openstack-System-Scope: None Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: User-Agent: python-novaclient Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Auth-Token: gAAAAABi8o7XQOATA1lSNL1wiS5YfSKdcDEHjApaHEKNPaMLzrjCJhhWimXQu9pNqHOwT60HySDKTUJQt_GcEDMH4c9-uZdDQMgy_JQtch5JTeGSa11qHHOVVwBgDwxqIT6LazxIbYtodKGWuOJ3owAQBUDtG-VNYWPxTAJph8gZtsfPMmW4doE Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Domain-Id: None Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Domain-Name: None Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Identity-Status: Confirmed Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Is-Admin-Project: True Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Domain-Id: default Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Domain-Name: Default Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Name: admin Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Role: member,admin,reader Aug 09 16:44:08.668227 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Roles: member,admin,reader Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_71a0f1acc61b45eba6ed6a5653958267", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}] Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant: admin Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant-Name: admin Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User: admin Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Domain-Id: default Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Domain-Name: Default Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Id: ca7d3603df364f0b9021187b3d134f71 Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Name: admin Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: method: > Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: exception: Flavor 84 could not be found. Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: action_args: {'id': '84'} Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:44:08.669526 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:08.670312 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:08.671401 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-2b055cc2-e2ac-4638-8263-b43b15ae2e00 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:44:08.672420 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-2b055cc2-e2ac-4638-8263-b43b15ae2e00 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011974 Aug 09 16:44:08.672420 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Aug 9 16:44:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:09.643424 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-1064359d-8a68-4cf5-a05e-acb348c21ec1 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:09.644454 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-1064359d-8a68-4cf5-a05e-acb348c21ec1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 09 16:44:09.644869 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:10.182596 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-e300f0df-6772-4a5b-a628-28e6fc6c88ea admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:10.188761 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.wsgi [None req-e300f0df-6772-4a5b-a628-28e6fc6c88ea admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-e300f0df-6772-4a5b-a628-28e6fc6c88ea admin admin] Request method failure captured: Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Accept: application/json Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Accept-Encoding: gzip, deflate Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Connection: keep-alive Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Content-Length: 0 Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Host: 10.222.0.59 Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Openstack-Api-Version: compute 2.90 Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Openstack-System-Scope: None Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: User-Agent: python-novaclient Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Auth-Token: gAAAAABi8o7ZwzvuNJOAkiCooOvuWHWnr_b4YRbXV-k03LN5LRvnPvTCt41bZiLSoWN3UbocdcsEWjTmpJOKnCdcpcLQct6HYMZ6QCWXtZ_XaWZlLrx21_DwhIML8PMwpa4a69l-8NxmdikqFbY61LLpLLB68N0hsyKarFoLQx6xW0nNyU_uchk Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Domain-Id: None Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Domain-Name: None Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Identity-Status: Confirmed Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Is-Admin-Project: True Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Domain-Id: default Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Domain-Name: Default Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Project-Name: admin Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Role: member,admin,reader Aug 09 16:44:10.190280 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Roles: member,admin,reader Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_71a0f1acc61b45eba6ed6a5653958267", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}] Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant: admin Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-Tenant-Name: admin Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User: admin Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Domain-Id: default Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Domain-Name: Default Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Id: ca7d3603df364f0b9021187b3d134f71 Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: X-User-Name: admin Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: method: > Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: exception: Flavor 451 could not be found. Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: action_args: {'id': '451'} Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:44:10.191664 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:10.193163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.194416 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-e300f0df-6772-4a5b-a628-28e6fc6c88ea admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110384) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:44:10.195489 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-e300f0df-6772-4a5b-a628-28e6fc6c88ea admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.407339 Aug 09 16:44:10.195489 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 16:44:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 16:44:10.202375 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-116f5c84-c201-4640-b44c-9bf608fb9808 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:10.217083 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-116f5c84-c201-4640-b44c-9bf608fb9808 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018304 Aug 09 16:44:10.217612 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 16:44:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:44:10.227357 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:10.243163 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019569 Aug 09 16:44:10.243728 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Aug 9 16:44:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:44:10.253284 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-cc856952-dbea-4257-ad42-52ac1401399c admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:10.259429 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.wsgi [None req-cc856952-dbea-4257-ad42-52ac1401399c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-cc856952-dbea-4257-ad42-52ac1401399c admin admin] Request method failure captured: Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Accept: application/json Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Accept-Encoding: gzip, deflate Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Connection: keep-alive Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Content-Length: 0 Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Host: 10.222.0.59 Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Openstack-Api-Version: compute 2.90 Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Openstack-System-Scope: None Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: User-Agent: python-novaclient Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Auth-Token: gAAAAABi8o7ZwzvuNJOAkiCooOvuWHWnr_b4YRbXV-k03LN5LRvnPvTCt41bZiLSoWN3UbocdcsEWjTmpJOKnCdcpcLQct6HYMZ6QCWXtZ_XaWZlLrx21_DwhIML8PMwpa4a69l-8NxmdikqFbY61LLpLLB68N0hsyKarFoLQx6xW0nNyU_uchk Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Domain-Id: None Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Domain-Name: None Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Identity-Status: Confirmed Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Is-Admin-Project: True Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Domain-Id: default Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Domain-Name: Default Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Project-Name: admin Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Role: member,admin,reader Aug 09 16:44:10.260939 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Roles: member,admin,reader Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/71a0f1acc61b45eba6ed6a5653958267"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_71a0f1acc61b45eba6ed6a5653958267", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/71a0f1acc61b45eba6ed6a5653958267"}]}] Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant: admin Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant-Id: 71a0f1acc61b45eba6ed6a5653958267 Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-Tenant-Name: admin Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User: admin Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Domain-Id: default Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Domain-Name: Default Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Id: ca7d3603df364f0b9021187b3d134f71 Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: X-User-Name: admin Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: method: > Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: exception: Flavor 451 could not be found. Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: action_args: {'id': '451'} Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:44:10.262575 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:10.263442 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: ERROR nova.api.openstack.wsgi Aug 09 16:44:10.264494 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-cc856952-dbea-4257-ad42-52ac1401399c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:44:10.265504 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-cc856952-dbea-4257-ad42-52ac1401399c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012581 Aug 09 16:44:10.265504 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 16:44:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:11.237649 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:11.238652 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 09 16:44:11.239062 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:11.769462 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-9717fb5c-908d-48a8-abec-3eb56fefe675 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:44:11.842763 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-9717fb5c-908d-48a8-abec-3eb56fefe675 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.463775 Aug 09 16:44:11.843506 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 16:44:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:44:12.862562 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:12.863607 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 09 16:44:12.864013 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:13.394032 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-56b845b1-75e1-4757-9dee-c94489e5cc28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:44:13.593071 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-56b845b1-75e1-4757-9dee-c94489e5cc28 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.590567 Aug 09 16:44:13.593554 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 16:44:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:44:14.585750 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:14.586799 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Aug 09 16:44:14.587220 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:15.117981 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-b79ec768-2117-4eb3-9472-9dfa04037e99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:44:15.191645 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-b79ec768-2117-4eb3-9472-9dfa04037e99 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.459372 Aug 09 16:44:15.192195 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 16:44:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:44:16.208911 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:16.209909 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 09 16:44:16.210301 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:16.760117 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-170581a0-6c96-4596-b990-e2f718861a76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:44:16.830770 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-170581a0-6c96-4596-b990-e2f718861a76 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.469759 Aug 09 16:44:16.831370 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Aug 9 16:44:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:44:17.816281 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:17.818167 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 09 16:44:17.818728 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:44:18.343157 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-024c0320-495c-4e17-b0aa-fc053fe9b82f admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:44:18.364214 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-024c0320-495c-4e17-b0aa-fc053fe9b82f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407298 Aug 09 16:44:18.365027 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Tue Aug 9 16:44:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:45:10.540902 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:45:10.541936 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-4c85303f-e9c7-4e79-a704-5f78ac9b7ff1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 09 16:45:10.542338 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 9 16:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:45:10.553813 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:45:10.933905 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-e242788f-dce2-4078-a438-4abac0455558 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:45:10.954286 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-e242788f-dce2-4078-a438-4abac0455558 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405850 Aug 09 16:45:10.954759 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 9 16:45:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:45:10.976518 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG dbcounter [-] [110384] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:45:10.980260 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-bcea6efd-5528-4f93-ab50-8723aec3b7ea admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:45:10.987776 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-bcea6efd-5528-4f93-ab50-8723aec3b7ea admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012841 Aug 09 16:45:10.988295 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Aug 9 16:45:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:45:10.999979 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-8447c33f-cf33-44eb-abf1-dc5cd28bc71a admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:45:11.008296 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-8447c33f-cf33-44eb-abf1-dc5cd28bc71a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011898 Aug 09 16:45:11.008813 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Aug 9 16:45:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:45:11.021089 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:45:11.028821 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012205 Aug 09 16:45:11.029355 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Aug 9 16:45:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:45:11.041530 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-915bb86f-b006-4907-a098-4bb47edf2324 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:45:11.049142 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-915bb86f-b006-4907-a098-4bb47edf2324 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011248 Aug 09 16:45:11.049654 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Aug 9 16:45:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:48:24.444987 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:24.446014 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 09 16:48:24.446415 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:48:24.588632 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_api:SELECT=6 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:24.747460 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:24.749919 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:48:24.749919 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: warnings.warn(msg) Aug 09 16:48:24.751035 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:24.751534 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:24.751959 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:24.752670 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:24.753112 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:24.753529 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:24.787892 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-9aae011f-cd52-429d-ab58-5c5c4a3835d5 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200369 Aug 09 16:48:24.788881 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 16:48:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:48:25.632452 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:25.633483 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 09 16:48:25.633906 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:48:25.824221 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:25.827315 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:48:25.827315 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: warnings.warn(msg) Aug 09 16:48:25.828526 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:25.828948 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:25.829387 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:25.830187 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:25.830635 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:25.831057 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:25.850508 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-e01eafb1-8eab-4cdc-bc46-ea3e94b1d1ba admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075497 Aug 09 16:48:25.851084 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 16:48:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:48:37.068660 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:37.069690 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 09 16:48:37.070079 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:48:37.214220 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_cell0:SELECT=4 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:37.214985 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_cell1:SELECT=4 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:37.215624 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG dbcounter [-] [110385] Writing DB stats nova_api:SELECT=8 {{(pid=110385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:37.263264 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:37.265812 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:48:37.265812 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: warnings.warn(msg) Aug 09 16:48:37.267523 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:37.268069 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:37.268503 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:37.269226 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:37.269674 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:37.270102 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:37.296335 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-e54de57e-2afe-41e2-94c0-5757d8567ab5 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086556 Aug 09 16:48:37.296825 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 16:48:37 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:48:38.128939 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: DEBUG nova.api.openstack.wsgi [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] Calling method '>' {{(pid=110384) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:38.129968 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: INFO nova.api.openstack.requestlog [None req-53e9e3cb-5b46-4f74-a7da-eee456f4dceb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 09 16:48:38.130383 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: [pid: 110384|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Aug 9 16:48:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:48:38.323266 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG nova.api.openstack.wsgi [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Calling method '>' {{(pid=110385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:48:38.325605 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:48:38.325605 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: warnings.warn(msg) Aug 09 16:48:38.326755 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:38.327296 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:38.327731 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:38.328451 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:48:38.328907 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:48:38.329562 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: DEBUG oslo_concurrency.lockutils [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:48:38.351237 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: INFO nova.api.openstack.requestlog [None req-a1809226-7fb6-44d9-9662-49cb70c648cc admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080306 Aug 09 16:48:38.351722 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: [pid: 110385|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Aug 9 16:48:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:49:38.708387 dv-cinder-852364-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 16:49:38.708953 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: Tue Aug 9 16:49:38 2022 - graceful shutdown triggered... Aug 09 16:49:38.709396 dv-cinder-852364-3-iscsi devstack@n-api.service[110384]: Gracefully killing worker 1 (pid: 110384)... Aug 09 16:49:38.709775 dv-cinder-852364-3-iscsi devstack@n-api.service[110385]: Gracefully killing worker 2 (pid: 110385)... Aug 09 16:49:39.709935 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: worker 1 buried after 1 seconds Aug 09 16:49:39.709935 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: worker 2 buried after 1 seconds Aug 09 16:49:39.709935 dv-cinder-852364-3-iscsi devstack@n-api.service[110383]: goodbye to uWSGI. Aug 09 16:49:39.711987 dv-cinder-852364-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 16:49:39.712548 dv-cinder-852364-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 16:49:39.715364 dv-cinder-852364-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 16:49:39.725097 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 16:49:39 2022] *** Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: nodename: dv-cinder-852364-3-iscsi Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: machine: x86_64 Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: clock source: unix Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: pcre jit disabled Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: detected number of CPU cores: 4 Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: current working directory: / Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: detected binary path: /usr/bin/uwsgi-core Aug 09 16:49:39.727338 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: your processes number limit is 47680 Aug 09 16:49:39.728057 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: your memory page size is 4096 bytes Aug 09 16:49:39.728057 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: detected max file descriptor number: 2048 Aug 09 16:49:39.728057 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: lock engine: pthread robust mutexes Aug 09 16:49:39.728057 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: thunder lock: enabled Aug 09 16:49:39.728057 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 16:49:39.728057 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 16:49:39.770481 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: Python main interpreter initialized at 0x55c4f4b399c0 Aug 09 16:49:39.770481 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: python threads support enabled Aug 09 16:49:39.770481 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: your server socket listen backlog is limited to 100 connections Aug 09 16:49:39.770481 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: your mercy for graceful operations on workers is 90 seconds Aug 09 16:49:39.770917 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 16:49:39.770917 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: *** Operational MODE: preforking *** Aug 09 16:49:39.771258 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: *** uWSGI is running in multiple interpreter mode *** Aug 09 16:49:39.771258 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: spawned uWSGI master process (pid: 124879) Aug 09 16:49:39.771464 dv-cinder-852364-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 16:49:39.772169 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: spawned uWSGI worker 1 (pid: 124900, cores: 1) Aug 09 16:49:39.774915 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: spawned uWSGI worker 2 (pid: 124901, cores: 1) Aug 09 16:49:39.774915 dv-cinder-852364-3-iscsi devstack@n-api.service[124879]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 16:49:40.444183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 16:49:40.457160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 16:49:41.620789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:49:41.620789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: from cryptography.utils import int_from_bytes Aug 09 16:49:41.621437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:49:41.621437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: from cryptography.utils import int_from_bytes Aug 09 16:49:41.637810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:49:41.637810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: from cryptography.utils import int_from_bytes Aug 09 16:49:41.638367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:49:41.638367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: from cryptography.utils import int_from_bytes Aug 09 16:49:43.991943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:49:43.992628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:49:43.992725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:49:43.993102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:49:43.993364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:49:43.993798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.994132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.994467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.994961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.995374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.997812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-3-iscsi {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.998324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.998324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.998469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.998807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.999044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:49:43.999532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.999635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:49:43.999721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.999801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:43.999987 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:49:44.000277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:49:44.000390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.000570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:49:44.001036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.001355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.001777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.001998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.002129 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.002330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.002553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.002820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.003048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.003292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.003513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.003736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.003959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.004180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.004416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.004663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.004887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.005101 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.005334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-3-iscsi {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.005559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.005782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.005989 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.006207 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.006428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.006823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.007602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-3-iscsi {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.007602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.008061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.008214 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.008421 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.008579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.008756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.008915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.009079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.009079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.009079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.009546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.009702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.009853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.010019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.010164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.010335 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.010335 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.010622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.010837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.011012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.011197 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.011360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.012380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.012548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.012728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.012887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.013041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.013199 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.013353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.013353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.013713 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.013858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014985 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.014985 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.015327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-3-iscsi {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.015474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.015631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.015786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.015941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.016086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.016239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.016513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.016687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.016838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.016983 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.017134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.017279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.017423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.017577 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.017732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.017878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018482 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.018919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.019072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.019282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.019464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.019610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.019763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.019908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020210 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020210 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.020951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.021106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.021258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.021408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.021561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.021732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.022661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.022781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.022872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.022950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023319 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.023951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024689 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024876 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.024972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025058 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025150 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025815 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.025912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.026965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.027162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.027330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.027480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.027680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.027827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.027981 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.028138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.028294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.028585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.028753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.028968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.029152 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.029312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.029467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.029623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.029779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.029935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.030091 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.030237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.030389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.030536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.030687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.030840 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.031005 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.031218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.031370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.031516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.031672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.031818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.032000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.032508 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.032656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.032802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.032946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.033101 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.033254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.033417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.033563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.033717 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.033869 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.034028 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.034275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.034428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.034428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.034796 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.034957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.035193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.035354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.035500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.035656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.035809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.035955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.036114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.036259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.036413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.036580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.036945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.037172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.037375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.037525 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.037670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.037837 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.038042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.038301 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.038508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.038660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.038813 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.038967 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.039194 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.039364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.039520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.039666 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.039824 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.039970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.040125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.040125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.040125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.040537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.040692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.040845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.040992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.041149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.041294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.041442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.041596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.041741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.041886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.042051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.042449 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.042696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.042696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.042987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.043164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.043316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.043470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.043630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.043783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.043936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.044088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.044272 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.044503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.044671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.044824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.045026 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.045181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.045334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.045480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.045637 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.045790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.045944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.046089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.046235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.046403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.046556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.046701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.046846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.046998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.047166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.047401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.047560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.047713 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.047859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.048004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.048167 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.048328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.048484 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.048637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.048789 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.048944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:49:44.049098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.049256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.049415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.049583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.049729 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.049874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050340 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050648 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.050938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.051096 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.051291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.051438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.051583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.051736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.051930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.052099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.052245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.052635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.052893 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.053052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.053199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.053354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.053501 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.054154 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.054154 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.054439 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.054687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.054848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055826 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.055971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056843 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.056995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.057157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.057302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.057553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.057553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.057846 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.057991 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.058146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.058300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.058459 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.058604 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.059024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.059225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.059376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.059608 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.059759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.059905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.060050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.060254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.060416 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.060575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.060722 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.060867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.061937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.062083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.062235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.062395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.062759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.062928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.063176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.063340 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.063496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.063717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.063872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.064031 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.064184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.064329 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.064489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.064669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.064892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.065092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.065244 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.065389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.065560 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.065720 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.065872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066350 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066821 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.066982 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.067212 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.067212 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.067554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.067778 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.067941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.068103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.068268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.068434 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.068595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.068748 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.068908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.069069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.069268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.070061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.070235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.070406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.070559 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.070710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.070872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.071044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.071237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.071401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.071554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.071705 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.071864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.072025 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.072185 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.072375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.072535 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.072912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073088 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.073835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.074280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.074433 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.074593 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.074753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.074923 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.075214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.075377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.075537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.075709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.075945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.076103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.076263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.076424 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.076583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.076746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.076898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.077077 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.077817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.078967 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.079186 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.079363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.079519 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.079680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.079842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.079995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.080157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.080319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.080472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.080630 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.080783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.080943 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.081110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.081273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.081434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.081585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.081744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.081898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.082065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.082217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.082368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.082527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.082680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.083115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.083292 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.083597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.083765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.083929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.084083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.084249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.084409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.084569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.084721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.084956 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.085146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.085442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.085611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.085773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.085773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.086074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.086225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.086389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.086550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.086710 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.086869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.087021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.087211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.087380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.087540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.087701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.087854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.088006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.088006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.088438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.088598 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.088757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.088918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.089077 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.089077 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.089384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.089776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.089937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.090091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.090244 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.090416 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.091371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.091604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.091786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.091925 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092525 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092667 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092667 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.092667 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.093401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.093593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.093748 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.093908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094377 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094377 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094728 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094813 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094906 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.094992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095840 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.095933 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.096992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097085 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097369 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097630 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097810 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097894 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.097978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098278 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098608 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.098927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.099963 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100300 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100871 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.100957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101813 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.101989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102506 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102603 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.102865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103047 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103405 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103405 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103877 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.103963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104828 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.104912 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105374 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105562 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105847 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.105934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106505 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106689 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106774 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.106929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.107073 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.107273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.107395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.107585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.107691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.107898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.108939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.109147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.109239 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.109459 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.109553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.109769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.109877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.110080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.110181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.110387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.110486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.110699 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.110958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.111053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.111361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.111456 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.111675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.111818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.112028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.112127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.112352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.112674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.113049 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.113176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.113382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.113507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.113718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.113855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.114111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.114378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.114482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.114671 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.114783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.114976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.115072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.115306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.115412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.115598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.115732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.115982 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.116868 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.117195 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.117293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.117518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.117628 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.117838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.117939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.118160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.118261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.118473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.118597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.118782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.118878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.119147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.119263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.119420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.119546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.119731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.119909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120058 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120161 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.120980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.121258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.121380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.121578 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.121692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.121882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.121976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.122189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.122284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.122499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.122759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.122855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.123134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.123245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.123443 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.123630 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.123796 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.123951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.124106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.124213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.124374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.124656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.124758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.124975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.125077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.125282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.125382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.125599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.125700 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.125906 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126213 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.126936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.127179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.127444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.127540 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.127754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.127848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.128070 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.128172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.128383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.128520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.128706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.128813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129120 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.129914 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130224 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130534 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.130964 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.131170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.131311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.131476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.131582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.131849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.132170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.132316 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.132522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.132662 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.132835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.132987 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.133202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.133298 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.133515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.133624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.133837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.133941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.134164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.134266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.134485 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.134593 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.134804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.134897 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.135668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.135800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.135945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.136957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.137950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.138181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.138284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.138512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.138605 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.138849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.138942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.139198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.139338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.139509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.139619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.139815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.139923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.140122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.140218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.140437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.140538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.140740 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.140847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141350 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141655 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.141973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.142103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.142293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.142483 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.142614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.142798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.143129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.143454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.143695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.143825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.144026 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.144157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.144352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.144480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.144694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.144816 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.145021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.145142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.145333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.145450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.145653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.145773 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.146004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.146143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.146423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.146742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.147216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.147910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.148263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.148687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.148792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.148882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.148978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.149072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.149170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.149245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150226 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150433 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150589 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150734 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.150886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.151677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.151780 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.151868 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.151953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.152866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.153091 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.153194 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.153406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.153500 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.153721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.153823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154455 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154667 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.154993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.155084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.155345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.155449 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.155672 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.155778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.155997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.156095 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.156429 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.156581 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.156759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.156869 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.157079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.157178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.157394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.157493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.157726 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.157831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158679 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.158994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.159087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.159338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.159438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.159674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.159899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.160000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.160307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.160406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.160623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.160726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.160954 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.161048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.161278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.161370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.161599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.161694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.161915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.162014 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.162243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.162342 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.162569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.162670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.162937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.163688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.163855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.164035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.164191 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.164361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.164507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.164685 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.164821 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165008 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165793 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.165964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.166087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.166401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.166507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.166719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.166838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.167034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.167283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.167426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.167568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.167710 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.167859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168606 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.168913 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.169056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.169236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.169402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.169557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.169886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.170066 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.170495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.170995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.171172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.171325 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.171920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.171920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.171920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.172455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.172605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.172799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.172965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.173113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.173251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.173435 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.173621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.173794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.173955 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.174107 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.174268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.174427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.174707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.174861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.175021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.175207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.175362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.175520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.175681 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.175843 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.176001 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.176152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.176314 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.176465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.176630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.176883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.177968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.178127 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.178278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.178438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.178623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.179007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.179503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.179657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.179807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.180924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.181916 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182100 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182185 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182737 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.182942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.183028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.183304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.183423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.183635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.183996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.184205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.184307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.184536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.184638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.184854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185024 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.185952 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.186149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.186402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.186549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.186741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.186890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.187069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.187254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.187416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.187591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.187739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.187904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.188063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.188216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.188387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.188531 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.188708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.188856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.189028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.189181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.189348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.189512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.189667 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.189830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.190002 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.190260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.190423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.190609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.190760 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191348 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.191955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.192094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.192269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.192389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.192588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.192730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193008 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.193855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.194355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.194489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.194585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.194744 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.194877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.195157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.195270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.195467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.195573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.195783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.195896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.196138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.196253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.196453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.196568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.196769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.196903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.197101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.197209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.197445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.197565 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.197775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.197880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.198096 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.198238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.198415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.198568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.198738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.198892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.199238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.199348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.199568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.199671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.199897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.199997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.200246 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.200402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.200582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.200710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.200906 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.201000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.201231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.201332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.201564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.201871 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.201965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.202181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.202280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.202498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.202602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.202814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.202907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.203143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.203240 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.203475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.203582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.203789 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.203881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.204100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.204192 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.204416 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.204515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.204729 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.204821 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.205044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.205270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.205372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.205626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.205719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.205946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.206048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.206277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.206378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.206608 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.206739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.206930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207030 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.207991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.208208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.208302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.208531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.208623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.208847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.208949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.209158 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.209250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.209469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.209569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.210510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.210970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211295 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211572 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.211934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.212164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.212265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.212473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.212573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.212784 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.212884 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.213102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.213204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.213414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.213519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.213724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.213817 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.214978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.215237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.215345 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.215563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.215656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.215901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.215993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.216233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.216328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.216549 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.216641 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.216861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.216964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.217180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.217294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.217492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.217604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.217810 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.217915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.218123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.218216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.218440 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.218548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.218755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.218858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.219071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.219249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.219412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.219532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.219727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.219861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.220047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.220171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.220372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.220600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.220797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.220946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.221211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.221332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.221561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.221691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.221880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222335 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.222957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224246 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.224908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.225003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.225103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.225196 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.225288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.225380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.225521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.226139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.226346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.226768 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.227904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.228041 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.228270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.228445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.228599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.228858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.229206 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.229644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.229798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.229945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230569 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230711 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230815 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.230953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.231085 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.231303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.231421 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.231625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.231740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.231951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.232056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.232269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.232367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.232592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.232688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.232910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.233994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.234153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.234326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.234473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.234646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.234809 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.234960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.235172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.235324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.235467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.235617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.235766 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.235921 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.236071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.236240 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.236372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.236573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.236694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.237991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.238181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.238285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.238493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.238595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.238809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.238910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.239153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.239263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.239472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.239573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.239782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.239875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.240090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.240193 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.240409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.240502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.240721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.240814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.241076 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.241195 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.241395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.241589 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.241762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.241924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.242130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.242278 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.242430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.242583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.242732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.242874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.243992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.244955 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.245175 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.245270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.245508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.245610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.245818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.245911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.246138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.246240 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.246460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.246555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.246783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.246876 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.247119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.247265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.247444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.247537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.247757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.247867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.248073 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.248205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.248394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.248495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.248719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.248820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.249036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.249128 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.249347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.249447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.249684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.249789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.250966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.251122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.251311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.251479 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.251629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.251805 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.251962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.252119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.252450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.252768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.253102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.253192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.253485 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.253581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.253836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.253939 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.254087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.254178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.254395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.254483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.254705 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.254802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.255014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.255142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.255355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.255439 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.255683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.255785 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.256033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.256127 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.256306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.256437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.256616 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.257266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.257489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258207 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.258993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.259167 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.259316 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.259474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.259618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.259618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.259905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.260054 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.260343 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.260673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.260985 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.261299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.261609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.261920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.262228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.262536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.262844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.263202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.263493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.263719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.263867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264841 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.264962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.265164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.265284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.265492 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.265621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.265940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.266106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.266227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.266444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.266571 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.266782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.266901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.267110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.267255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.267438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.267559 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.267757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.267878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124901) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:49:44.268075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.268411 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.268701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.269034 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.269370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.269683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.270015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.270517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.270853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.271208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.271528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.271867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.272187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.273197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.273520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.273894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.274288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.274466 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.274788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.275130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.275468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.275794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.276248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.276546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.276867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.277202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.277534 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.277896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.278216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.278567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.278900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.279256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.279579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.279892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:49:44.280149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:49:44.426298 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO dbcounter [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Registered counter for database nova_api Aug 09 16:49:44.437271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO dbcounter [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Registered counter for database nova_api Aug 09 16:49:44.450168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_db.sqlalchemy.engines [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.457159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writer thread running {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.463709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_db.sqlalchemy.engines [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.472824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writer thread running {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.517063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.context [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795ddccc-4e3b-400c-a74d-b466147e7ecd(cell1) {{(pid=124901) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 16:49:44.521109 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:49:44.521595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:49:44.523910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:49:44.524671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:49:44.525132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:49:44.527149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:49:44.529153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO dbcounter [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Registered counter for database nova_cell0 Aug 09 16:49:44.531360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.context [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),795ddccc-4e3b-400c-a74d-b466147e7ecd(cell1) {{(pid=124900) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 16:49:44.533283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO dbcounter [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Registered counter for database nova_cell1 Aug 09 16:49:44.535485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:49:44.536088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:49:44.539651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:49:44.539651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:49:44.539651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:49:44.540405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_db.sqlalchemy.engines [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.540897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:49:44.542264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_db.sqlalchemy.engines [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.542953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO dbcounter [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Registered counter for database nova_cell0 Aug 09 16:49:44.547453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO dbcounter [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Registered counter for database nova_cell1 Aug 09 16:49:44.548744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writer thread running {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.550490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writer thread running {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.554706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_db.sqlalchemy.engines [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.556425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_db.sqlalchemy.engines [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.562629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writer thread running {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.564243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writer thread running {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.699032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO dbcounter [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Registered counter for database nova_cell0 Aug 09 16:49:44.706635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_db.sqlalchemy.engines [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124901) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.712052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writer thread running {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:44.712181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO dbcounter [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Registered counter for database nova_cell0 Aug 09 16:49:44.718709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_db.sqlalchemy.engines [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:49:44.723130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writer thread running {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:49:45.031521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: WARNING keystonemiddleware.auth_token [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:49:45.039378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: WARNING keystonemiddleware.auth_token [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:49:45.046615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: WARNING keystonemiddleware.auth_token [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:49:45.054118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: WARNING keystonemiddleware.auth_token [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:49:45.387647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: WARNING keystonemiddleware.auth_token [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:49:45.394055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: WARNING keystonemiddleware.auth_token [None req-7e212f80-7518-4081-9cd2-02e9a9beb161 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:49:45.400740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4f4b399c0 pid: 124901 (default app) Aug 09 16:49:45.409473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: WARNING keystonemiddleware.auth_token [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 16:49:45.415701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: WARNING keystonemiddleware.auth_token [None req-8bcef0fe-d29f-4534-952a-4a8a4563c87a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 16:49:45.422393 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c4f4b399c0 pid: 124900 (default app) Aug 09 16:50:22.938748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:22.939565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:22.941371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:22.942257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:24.383389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-604f73e4-bac4-497b-a5c2-2eae34ab63c1 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Action: 'create', calling method: .version_select at 0x7fccc6c84dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-908643640", "metadata": {"Type": "work"}}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:26.788136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-604f73e4-bac4-497b-a5c2-2eae34ab63c1 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.866536 Aug 09 16:50:26.809560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 16:50:22 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3889 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 16:50:26.816325 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:26.823367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:26.826511 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:26.828519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:27.231627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f666e612-d8aa-4eba-b459-379bb48383bf tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Calling method '.version_select at 0x7fccc6cf78b0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:28.121633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f666e612-d8aa-4eba-b459-379bb48383bf tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23" status: 200 len: 352 microversion: 2.1 time: 1.316835 Aug 09 16:50:28.122279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 1/2] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:50:26 2022] GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 => generated 352 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:50:29.148001 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c8bae20d-9720-479d-9c0d-be71626af709 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Calling method '.version_select at 0x7fccc6b76c10>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:29.285373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c8bae20d-9720-479d-9c0d-be71626af709 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23" status: 200 len: 353 microversion: 2.1 time: 0.153023 Aug 09 16:50:29.298979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:50:29 2022] GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:50:29.300759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-04040117-ea4d-439c-966c-85fbbd59e640 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Calling method '.version_select at 0x7fccc6b3bc10>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:29.413144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-04040117-ea4d-439c-966c-85fbbd59e640 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23" status: 200 len: 353 microversion: 2.1 time: 0.116443 Aug 09 16:50:29.413912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:50:29 2022] GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:50:29.435949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1876b2b3-cae1-4ca1-acd1-2a62cf8a0cd6 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Calling method '.version_select at 0x7fccc6b19310>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:29.712875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1876b2b3-cae1-4ca1-acd1-2a62cf8a0cd6 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23" status: 202 len: 0 microversion: 2.1 time: 0.283239 Aug 09 16:50:29.715196 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:50:29 2022] DELETE /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:50:29.721926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e2f6ab3f-3f5f-48fd-b605-2261aa35b6ef tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Calling method '.version_select at 0x7fccc6b77310>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:29.866998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e2f6ab3f-3f5f-48fd-b605-2261aa35b6ef tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23" status: 200 len: 352 microversion: 2.1 time: 0.148695 Aug 09 16:50:29.867997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:50:29 2022] GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:50:30.884135 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-60ee82bd-6d8c-4b2e-bd90-597c177eb689 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Calling method '.version_select at 0x7fccc6b199d0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:30.947793 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-60ee82bd-6d8c-4b2e-bd90-597c177eb689 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] HTTP exception thrown: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-60ee82bd-6d8c-4b2e-bd90-597c177eb689 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Request method failure captured: Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 HTTP/1.1 Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBOXSILZzzIp1zYl7B3k3HuSfhvO3q2ZOXagLCzou4d1xCX099BfaNLvJaGXXSqUkZlFfEk19RruFajTK_JwFbSxWD25i4r_CK_E4uTFwzH1FcNZkQ2BZWvxMLgU5PK5qpCpsoE1Iam_eorj9sVmtYGyS01mJEViwiGx5mWkmBiNLE Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 34d8c5b4587b485a88d52f9955ad0ec7 Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesGetTestJSON-837742852 Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:50:30.953142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/34d8c5b4587b485a88d52f9955ad0ec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/34d8c5b4587b485a88d52f9955ad0ec7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_34d8c5b4587b485a88d52f9955ad0ec7", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/34d8c5b4587b485a88d52f9955ad0ec7"}]}] Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesGetTestJSON-837742852 Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 34d8c5b4587b485a88d52f9955ad0ec7 Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesGetTestJSON-837742852 Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesGetTestJSON-837742852-project Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 1a0e490ee76a44c3b3efd9b99cb0f9df Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesGetTestJSON-837742852-project Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'f2c92526-c58e-49c5-b42c-38c8b5695b23'} Aug 09 16:50:30.954178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. (HTTP 404) (Request-ID: req-1d1e4670-6fbc-4ee8-b834-8a10b2ee939a) Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:50:30.954884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:50:30.956098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 16:50:30.956953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-60ee82bd-6d8c-4b2e-bd90-597c177eb689 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] Returning 404 to user: Volume f2c92526-c58e-49c5-b42c-38c8b5695b23 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:50:30.957886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-60ee82bd-6d8c-4b2e-bd90-597c177eb689 tempest-VolumesGetTestJSON-837742852 tempest-VolumesGetTestJSON-837742852-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23" status: 404 len: 109 microversion: 2.1 time: 0.078195 Aug 09 16:50:30.963014 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:50:30 2022] GET /compute/v2.1/os-volumes/f2c92526-c58e-49c5-b42c-38c8b5695b23 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:50:36.896340 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-03435b9e-aec1-4329-b80f-c733933af438 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: .version_select at 0x7fccc6b3bca0>, body: {"keypair": {"name": "tempest-keypair-1219298482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhUnVoQ86Rm51BjZvXS90ag8Jpgmut8+c8lpFKgNUsxLcAJDjfp15xuejFs7zaje7zA3/PjlAh5dsqZ8SbZ8ZnblRVXePM9FsjnwY1cNqdz6h2K+dKPKXWGpT2S2bKsxQ=="}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:37.046412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-03435b9e-aec1-4329-b80f-c733933af438 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for project 54562f03aaae457ca88be251d2208e2e. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:37.065598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-03435b9e-aec1-4329-b80f-c733933af438 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for user 7c0e3a34f13440b38fdf0ced22dc5a01 and project 54562f03aaae457ca88be251d2208e2e. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:37.281889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-03435b9e-aec1-4329-b80f-c733933af438 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.266844 Aug 09 16:50:37.287490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 4/8] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:50:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:50:42.073480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1016981313", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6e9ea29-d63f-40f2-84ee-974e268aa2d8"}], "security_groups": [{"name": "tempest-securitygroup--1583060255"}], "key_name": "tempest-keypair-1219298482", "user_data": "}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:42.314886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1596894080", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:42.350889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] validate_networks() for [('c6e9ea29-d63f-40f2-84ee-974e268aa2d8', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:50:42.504172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] validate_networks() for [('e7c6cdf7-0095-4da2-9004-cdee3c973d7e', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:50:43.292195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:50:43.292692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:50:43.293093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:50:43.293507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:50:43.293922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:50:43.318190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:43.318718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:43.319202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:43.322138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:43.322658 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:43.325220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:43.345137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:50:43.345767 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:50:43.346387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:50:43.346905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:50:43.347460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:50:43.365994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:43.366641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:43.367192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:43.368283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:43.368771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:43.369198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:43.388260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for project 54562f03aaae457ca88be251d2208e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:43.394044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for user 7c0e3a34f13440b38fdf0ced22dc5a01 and project 54562f03aaae457ca88be251d2208e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:43.408867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:43.409753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:50:43.414456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:50:43.421622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for user c4529e57de654b36b53662be0148834c and project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:43.440373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:50:43.443777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:50:43.637499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e459c0de-f2c6-4e0d-9d3d-eb62af7b2f7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.577040 Aug 09 16:50:43.638158 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 5/9] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:50:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:50:43.649897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-59a7f06f-9426-4a14-b7a3-dd6052344b9b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.590125 Aug 09 16:50:43.657188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 5/10] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:50:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:50:44.016146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1141788467", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "networks": [{"uuid": "282e3700-6650-40cf-853f-239074e73a36"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:44.041765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f68bd238-dd18-4241-97bd-22ed0a9d242f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: .version_select at 0x7fccc617d790>, body: {"keypair": {"name": "tempest-keypair-290511939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJMCDN+Oa6mBxVuTe3lP7JdCy1MMMezzbhvtQCMRKCftuUHV1W72+P5nPGrkpxadDoFX1HPxo2O1FtsdfqPSaM6DcBQpTzhnBAbPf0kYh/dLxf4LaU9xMuu/Xru74W7WQ=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:44.078178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-f68bd238-dd18-4241-97bd-22ed0a9d242f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:44.083517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-f68bd238-dd18-4241-97bd-22ed0a9d242f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:44.094205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] validate_networks() for [('282e3700-6650-40cf-853f-239074e73a36', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:50:44.282080 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f68bd238-dd18-4241-97bd-22ed0a9d242f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.642126 Aug 09 16:50:44.283154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 6/11] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:50:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:50:44.293347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4fca20bb-b78d-423a-9568-5f9bdf6956f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:44.294254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4fca20bb-b78d-423a-9568-5f9bdf6956f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:44.451664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4fca20bb-b78d-423a-9568-5f9bdf6956f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:44.500838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4fca20bb-b78d-423a-9568-5f9bdf6956f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1222 microversion: 2.1 time: 0.213777 Aug 09 16:50:44.500838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 7/12] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:44 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1222 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:44.519564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b8cf877c-55af-4373-b3fd-2653356d8fef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:44.520934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b8cf877c-55af-4373-b3fd-2653356d8fef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:44.934536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b8cf877c-55af-4373-b3fd-2653356d8fef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:44.941933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b8cf877c-55af-4373-b3fd-2653356d8fef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1238 microversion: 2.1 time: 0.442051 Aug 09 16:50:44.960388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 8/13] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:44 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1238 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:44.969612 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-614702761", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:45.095647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] validate_networks() for [('e7c6cdf7-0095-4da2-9004-cdee3c973d7e', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:50:45.406265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:50:45.407043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:50:45.407514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:50:45.407935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:50:45.408535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:50:45.435248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:45.435745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:45.460068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:45.460068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:45.460068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:45.460068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:45.547866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Getting quotas for project 4533225c6c3147308e6bfbc4a7fbf788. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:45.582357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Getting quotas for user cbb77041409e4caa81b4acac46464af1 and project 4533225c6c3147308e6bfbc4a7fbf788. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:45.654884 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:50:45.659920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:50:45.884670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-079ff5b9-a1c9-4f72-8776-e7bc83dc6278 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232299 Aug 09 16:50:45.885249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 6/14] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:50:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:50:45.908595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5a5918e3-bccb-4b52-86ff-da513235f977 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:45.917898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5a5918e3-bccb-4b52-86ff-da513235f977 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:46.293331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5a5918e3-bccb-4b52-86ff-da513235f977 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:46.333213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5a5918e3-bccb-4b52-86ff-da513235f977 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1215 microversion: 2.1 time: 0.435953 Aug 09 16:50:46.333780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 7/15] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:45 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1215 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:46.357754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1d8a4416-b0cd-4b2b-8cdd-2b8c72f637c5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:46.361595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1d8a4416-b0cd-4b2b-8cdd-2b8c72f637c5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:46.560521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1d8a4416-b0cd-4b2b-8cdd-2b8c72f637c5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:46.578349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1d8a4416-b0cd-4b2b-8cdd-2b8c72f637c5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1238 microversion: 2.1 time: 0.234253 Aug 09 16:50:46.580997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:46 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1238 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:46.717848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:50:46.718629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:50:46.719519 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:50:46.720300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:50:46.721133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:50:46.740300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:46.740300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:46.740300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:46.741359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:46.742029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:46.742659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:46.796864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:46.813874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for user c4529e57de654b36b53662be0148834c and project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:46.849748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:50:46.855764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:50:47.049984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b8aa7543-f8bc-4d86-aea1-e1d43d373498 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.078562 Aug 09 16:50:47.049984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 9/17] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:50:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:50:47.055408 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8d5ffd00-501e-43ec-a67c-f7034b13036b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:47.057885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8d5ffd00-501e-43ec-a67c-f7034b13036b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:47.252378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8d5ffd00-501e-43ec-a67c-f7034b13036b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:47.263202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8d5ffd00-501e-43ec-a67c-f7034b13036b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1221 microversion: 2.1 time: 0.212367 Aug 09 16:50:47.264500 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 9/18] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:47 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:47.373279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-dcfdf350-6f9c-43d9-a817-f831df49f249 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:47.376988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-dcfdf350-6f9c-43d9-a817-f831df49f249 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:47.594011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dcfdf350-6f9c-43d9-a817-f831df49f249 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:47.606482 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:47.610385 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:47.620814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-dcfdf350-6f9c-43d9-a817-f831df49f249 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1215 microversion: 2.1 time: 0.265251 Aug 09 16:50:47.624800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 10/19] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:47 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:47.626905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:47.628298 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:47.629021 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:47.631182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:47.631908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:47.632452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:48.310011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1ccd7509-cdf0-4279-9c7e-50f646044da2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:48.312344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1ccd7509-cdf0-4279-9c7e-50f646044da2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:48.387292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:48.408714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9a4c0fe2-9748-412d-a501-91af92aa8008 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1242 microversion: 2.1 time: 0.810398 Aug 09 16:50:48.427445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 10/20] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:47 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1242 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:48.473673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1ccd7509-cdf0-4279-9c7e-50f646044da2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:48.496519 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1ccd7509-cdf0-4279-9c7e-50f646044da2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1221 microversion: 2.1 time: 0.198404 Aug 09 16:50:48.498049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 11/21] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:48 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:48.657585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:48.660514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:48.691658 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:48.694909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:48.696759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:48.703162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:48.704449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:48.705514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:49.021726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:49.045380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ce5abec4-9b25-451e-8351-98fa2eba0329 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1219 microversion: 2.1 time: 0.399877 Aug 09 16:50:49.070445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 11/22] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:48 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1219 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:49.432930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:49.434474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:49.465231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:49.476782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:49.477834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:49.485051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:49.487721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:49.493117 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:49.520893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:49.526603 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:49.561949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:49.567782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:49.567782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:49.567782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:49.583585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:49.586229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:49.847147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:49.856696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7a7bcf89-8b2f-4300-8a20-9714d02a3a75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1217 microversion: 2.1 time: 0.343810 Aug 09 16:50:49.862278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:49 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1217 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:49.938806 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:49.959032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6fa56faf-eab3-4f6c-9c32-418bb7ae7588 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1290 microversion: 2.1 time: 0.525428 Aug 09 16:50:49.959032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 12/24] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:49 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1290 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:50.077709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:50.078835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:50.092137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:50.096735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:50.097296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:50.098746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:50.099531 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:50.100067 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:50.472108 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:50.494701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-64a727ae-9a9f-4eed-b3fa-4ba348187418 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1267 microversion: 2.1 time: 0.410949 Aug 09 16:50:50.497547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:50 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1267 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:50.890371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:50.891133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:50.909311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:50.910816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:50.913943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:50.915464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:50.918362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:50.919994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:50.981098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:50.983574 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:50.995573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:50.996586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:50.997197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:50.998153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:50.999269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:51.000250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:51.119076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:51.127297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:51.137055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e3f0e183-844a-4193-94a7-46f6897cdda5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1273 microversion: 2.1 time: 0.258840 Aug 09 16:50:51.139445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-750b84cc-b3f6-486a-b04b-57697ccafe36 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1290 microversion: 2.1 time: 0.162097 Aug 09 16:50:51.140679 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 14/26] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:50 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1290 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:50:51.155774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 13/27] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:50 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:51.526453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:51.528051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:51.565619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:51.569005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:51.569423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:51.571651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:51.572270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:51.572729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:51.592924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1910568514", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d512bb64-4fdf-40f1-b457-d57f69ae1831"}], "security_groups": [{"name": "tempest-securitygroup--1154086863"}], "key_name": "tempest-keypair-290511939", "user_data": "}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:51.836671 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:51.850797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-016c395e-3d8c-4efe-a389-109ac499272a tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1275 microversion: 2.1 time: 0.331201 Aug 09 16:50:51.851701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 15/28] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:51 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1275 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:52.162704 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:52.166079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:52.182520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:52.183198 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:52.183588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:52.184549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:52.185006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:52.200193 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:52.266790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] validate_networks() for [('d512bb64-4fdf-40f1-b457-d57f69ae1831', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:50:52.712212 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:52.735650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-69f1ab32-e93d-4185-b2c8-4ff010c1d2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1308 microversion: 2.1 time: 0.577748 Aug 09 16:50:52.756664 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 16/29] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:52 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1308 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:50:52.786470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:52.791131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:52.815339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:52.817929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:52.818591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:52.819592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:52.820557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:52.838099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:52.953516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:52.967428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5f22c40b-aa0e-4af2-aa2c-5ba94eb566ce tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1279 microversion: 2.1 time: 0.198837 Aug 09 16:50:52.971417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 17/30] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:52 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1279 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:52.981454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:52.992366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:53.004324 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:53.004931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:53.005470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:53.006738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:53.021221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:53.023010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:53.211046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:53.219464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ab142ee5-bec3-44a6-8e3b-39d1f9c50ccb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1273 microversion: 2.1 time: 0.244382 Aug 09 16:50:53.225473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 18/31] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:52 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:53.769018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:53.770055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:53.778036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:53.778919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:53.779623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:53.781002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:53.782115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:53.782738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:53.877416 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:53.897140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-318b25da-4af2-4fc6-86dc-67a965a51409 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1296 microversion: 2.1 time: 0.130960 Aug 09 16:50:53.897140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 19/32] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:53 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1296 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:53.994985 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:53.995833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:54.011750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:54.014693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:54.014693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:54.017939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:54.018499 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:54.018950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:54.586302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:54.599802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-59ab7304-e4c0-4d36-a04d-e51e03c86b59 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.609037 Aug 09 16:50:54.616064 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 20/33] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:53 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:50:54.634022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:54.640229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:54.659210 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:54.662676 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:54.663159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:54.670424 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:54.673023 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:54.679027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:54.828460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:50:54.828985 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:50:54.829372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:50:54.829791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:50:54.830211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:50:54.854997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:54.855537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:54.860323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:54.867706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:54.870278 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:54.870771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:54.939390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:50:54.951668 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:50:55.012821 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:50:55.020188 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:50:55.083050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:55.124429 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-84341e0e-e766-446d-92a4-41621c5fd676 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1273 microversion: 2.1 time: 0.500181 Aug 09 16:50:55.124429 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 21/34] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:54 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1273 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:55.172195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:55.173167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:55.193955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:55.201514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:55.206093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:55.210003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:55.210512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:55.217612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:55.318043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-00799fa1-02fa-44bd-9ee7-639ccb5474ae tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.726660 Aug 09 16:50:55.327395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 14/35] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:50:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:50:55.356203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2750d0f9-6987-4117-8570-56894912574a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:55.368537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2750d0f9-6987-4117-8570-56894912574a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:55.510907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=4 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:55.555947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2750d0f9-6987-4117-8570-56894912574a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:55.587556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2750d0f9-6987-4117-8570-56894912574a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1241 microversion: 2.1 time: 0.256967 Aug 09 16:50:55.608722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 15/36] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:55 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1241 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:55.626276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:55.627743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:55.647561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:55.649267 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:55.650040 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:55.651870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:55.654591 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:55.655053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:55.687922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:55.703522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3f56413b-0131-4fb4-8b03-f74cd2db1664 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1296 microversion: 2.1 time: 0.577095 Aug 09 16:50:55.706820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 22/37] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:55 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1296 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:56.142426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:56.143295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:56.157068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:56.157068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:56.161755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:56.162797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:56.163544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:56.164146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:56.581690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:56.592493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c65e62a0-67c4-4c42-a1ad-8da0e559f451 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.974425 Aug 09 16:50:56.613859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 16/38] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:55 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:56.627037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e898a0e2-9c22-4e73-9432-9a6fd0dca095 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:56.629262 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e898a0e2-9c22-4e73-9432-9a6fd0dca095 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:56.891755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:56.931799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d47e02b2-10e4-4449-8198-c14408adb4bb tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.772132 Aug 09 16:50:56.931799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 23/39] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:56 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:50:56.945000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:56.945649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:56.971502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:56.975377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:56.978601 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:56.984188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:56.984188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:56.987526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:57.064426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e898a0e2-9c22-4e73-9432-9a6fd0dca095 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:57.077145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e898a0e2-9c22-4e73-9432-9a6fd0dca095 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1241 microversion: 2.1 time: 0.457488 Aug 09 16:50:57.078860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 17/40] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:56 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1241 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:57.313710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=22 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:57.481515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:57.537027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-72e3cd1a-80e6-4ad4-ba92-6e9ddb2dce6e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.597097 Aug 09 16:50:57.542125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 24/41] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:56 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:57.619629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:57.621077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:57.628993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:57.631431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:57.632349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:57.633301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:57.633953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:57.634538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:57.942465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:57.943921 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:57.947571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:57.959427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:57.961206 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:57.966552 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:57.967729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:57.968490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:57.969204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:58.204569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:58.212914 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:50:58.215879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7a72e8d5-db0c-4917-8b07-e127a0f2169f tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.278947 Aug 09 16:50:58.227896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 25/42] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:57 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:50:58.250646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:58.251851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:58.264452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:58.266935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:58.267963 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:58.272895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:58.274459 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:58.279016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:58.617122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:58.628089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fbe5d003-0599-442f-ab5e-d763c8316b6b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1245 microversion: 2.1 time: 0.398654 Aug 09 16:50:58.628758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 26/43] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:58 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1245 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:59.039809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:59.055188 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b8f637ac-801a-4d9b-9345-edcbb36f6bdf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 1.440305 Aug 09 16:50:59.056011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 18/44] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:57 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:59.069979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:59.070960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:59.109833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.113313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.114742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.119325 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.120011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.121019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.161223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad3d121-535f-4a16-b412-574cf5da50e9", "tag": "ba04df11-96c3-4666-be53-8af43db1ed2d"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:50:59.184667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.185404 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.186057 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.259284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Creating event network-changed:ba04df11-96c3-4666-be53-8af43db1ed2d for instance bad3d121-535f-4a16-b412-574cf5da50e9 on hv-cinder-85236 Aug 09 16:50:59.259284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124900) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 16:50:59.259284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6ccb4ae7-87d8-4813-a2c1-dafdffa124b4 req-99005d4b-951c-471d-8486-55ccd8f1a3ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=124900) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 16:50:59.261598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.262425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.263025 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.276734 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.277472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.278703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.300549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.compute.rpcapi [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 16:50:59.306643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] Releasing lock "compute-rpcapi-router" {{(pid=124900) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 16:50:59.350597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b8d08e3d-b663-4a1b-bc15-1fcca7b66eb2 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.720130 Aug 09 16:50:59.353018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 27/45] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:50:59.362080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:59.362080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:59.369306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.370174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.370691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.371495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.372084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.372613 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.614549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:59.641328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-52f4d615-d6b8-4212-adb2-319c80d3df75 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.276002 Aug 09 16:50:59.646006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 28/46] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:59 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:59.690496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:59.705201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0791ec10-778f-43c1-8b86-f79f2c89d95e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.645603 Aug 09 16:50:59.705321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:50:59.705516 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 19/47] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:59 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:50:59.713221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:50:59.733124 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.736643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.737520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.738760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:50:59.740576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:50:59.741290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:50:59.977143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:50:59.989491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e51802c1-3c17-4c58-9f1b-1461cac35cd1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1293 microversion: 2.1 time: 0.327313 Aug 09 16:50:59.996801 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 29/48] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:50:59 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1293 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:00.079965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:00.086233 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:00.089335 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:00.090009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:00.090640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:00.091400 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:00.092114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:00.092700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:00.893707 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-d095d89a-30ef-4253-93b0-91cec6a3b14a req-d737ddd2-466c-4939-806b-a49e00d00bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d48aed-6528-46cd-a11e-6899591a4a27", "tag": "53a24594-3349-4f0d-b4fe-6c7d9baea3f2"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:00.915546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d095d89a-30ef-4253-93b0-91cec6a3b14a req-d737ddd2-466c-4939-806b-a49e00d00bef service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:00.917336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d095d89a-30ef-4253-93b0-91cec6a3b14a req-d737ddd2-466c-4939-806b-a49e00d00bef service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:00.917993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d095d89a-30ef-4253-93b0-91cec6a3b14a req-d737ddd2-466c-4939-806b-a49e00d00bef service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:00.929905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:00.945754 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cbc86c5f-d692-421d-af51-edc3726932cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.870821 Aug 09 16:51:00.952801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 20/49] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:00 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:00.959002 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:00.970557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-d095d89a-30ef-4253-93b0-91cec6a3b14a req-d737ddd2-466c-4939-806b-a49e00d00bef service nova] Creating event network-changed:53a24594-3349-4f0d-b4fe-6c7d9baea3f2 for instance a4d48aed-6528-46cd-a11e-6899591a4a27 on hv-cinder-85236 Aug 09 16:51:00.977693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:00.990600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-d095d89a-30ef-4253-93b0-91cec6a3b14a req-d737ddd2-466c-4939-806b-a49e00d00bef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438078 Aug 09 16:51:00.991887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 30/50] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:00.996563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:00.999024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:00.999799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:01.000280 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:01.001375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:01.002852 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:01.004905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:01.006362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:01.007351 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:01.018859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:01.022150 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:01.022805 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:01.024030 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:01.026639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:01.027301 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:01.557658 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:01.578619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-67a8fb79-2754-412a-a8a4-5c957f1f8b24 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.583504 Aug 09 16:51:01.591130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 31/51] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:00 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:01.591130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:01.597485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:01.610243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:01.610745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:01.611217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:01.611934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:01.612391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:01.612821 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:01.833217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:01.842880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fde3b962-37c2-47aa-8016-6d99c36c8bb5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1311 microversion: 2.1 time: 0.261513 Aug 09 16:51:01.844504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 32/52] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:01 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:01.974682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:01.979711 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:01.981890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:01.994350 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-40df2a9e-dc50-4dca-b51d-b113d149ae35 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 1.039491 Aug 09 16:51:01.994947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 21/53] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:00 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:01.998602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:02.000463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:02.000919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:02.001663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:02.002149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:02.002584 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:02.564056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:02.585720 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1b2561ca-1a8e-41fa-9791-2edfdbdf7e4f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.610070 Aug 09 16:51:02.590509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 33/54] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:01 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:02.603678 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:02.604749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:02.627568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:02.628079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:02.628682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:02.629961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:02.630446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:02.630885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:02.869321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:02.869956 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:02.887939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:02.889864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:02.891528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:02.894547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:02.895293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:02.895840 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:03.002927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:03.027046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-08247c03-32f5-4ed7-bb61-81682491085d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1299 microversion: 2.1 time: 0.164366 Aug 09 16:51:03.029453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 34/55] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:02 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:03.046337 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:03.047272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:03.057318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:03.058426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:03.058534 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:03.060050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:03.061555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:03.063096 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:03.369937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:03.383503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-69a9fad4-7562-4831-9286-77917ef10fde tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.350082 Aug 09 16:51:03.383715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 35/56] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:03 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:03.395577 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c8e995-dd9a-483b-9c1a-d9301cf27f1e", "tag": "5ad131fe-fddf-4bca-bf02-1713526341b7"}, {"name": "network-changed", "server_uuid": "e7a274d0-9d37-4f6f-8a7e-2f223cf42198", "tag": "c7c7c2fe-a482-49a1-bef6-cb7da54c233e"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:03.416084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:03.416084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:03.416084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:03.447627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] Creating event network-changed:5ad131fe-fddf-4bca-bf02-1713526341b7 for instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e on hv-cinder-85236 Aug 09 16:51:03.448129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] Creating event network-changed:c7c7c2fe-a482-49a1-bef6-cb7da54c233e for instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 on hv-cinder-85236 Aug 09 16:51:03.467306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-ce03f535-cdb4-4d46-acee-66fb23a7d878 req-5e97adb2-d7f2-42bf-aee4-ecc069c9961e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.080243 Aug 09 16:51:03.467912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 36/57] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:03.612140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:03.612861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:03.621158 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:03.621739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:03.622234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:03.623049 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:03.623635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:03.624318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:03.642546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:03.653840 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9e2b171e-7ad6-4308-9674-85150855e731 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 1.054585 Aug 09 16:51:03.655008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 22/58] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:02 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:03.935813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:03.951717 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-345a6704-c770-4ead-b7c1-5672963967f5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.342194 Aug 09 16:51:03.952585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 37/59] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:03 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:04.051818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:04.052748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:04.068893 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:04.070676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:04.071648 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:04.074033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:04.076017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:04.084123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:04.343355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:04.354212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b0af9008-8cf2-4ca3-8712-72c835510ca6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1299 microversion: 2.1 time: 0.306207 Aug 09 16:51:04.357203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 23/60] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:04 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1299 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:04.404330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:04.404929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:04.412978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:04.413492 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:04.419421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:04.420389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:04.421038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:04.422311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:04.675540 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:04.677525 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:04.678606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:04.689364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:04.690074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:04.707086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:04.707086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:04.707086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:04.707086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:04.707624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-df2c63a9-c79a-43f8-9e00-06f5bf746d77 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.296958 Aug 09 16:51:04.707624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 38/61] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:04 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:04.886111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=6 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:04.979188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:04.980422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:04.990386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:05.005950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:05.006998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:05.010327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:05.012648 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:05.013893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:05.097009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:05.123759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-97fe2b42-b95d-4bf6-87b7-63b189d56c6f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.436754 Aug 09 16:51:05.124424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 24/62] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:04 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:05.287471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:05.299481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9771652d-3fbb-46f2-92cc-7557fd21f92f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.324052 Aug 09 16:51:05.311235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 39/63] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:04 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:05.382110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:05.383050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:05.390783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:05.391697 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:05.392333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:05.393250 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:05.393944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:05.394688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:05.727876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:05.728476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:05.740056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:05.741408 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:05.743000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:05.745579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:05.746839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:05.748390 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:05.894616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:05.913724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-277c4004-90e2-47a8-a939-154cce0a094d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.539310 Aug 09 16:51:05.914333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 25/64] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:05 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:06.021234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:06.033818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f2f7b4aa-6dce-45a0-961e-e54c394c39c3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.310944 Aug 09 16:51:06.037264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 40/65] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:05 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:06.146178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:06.147052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:06.155687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:06.156232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:06.156669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:06.158583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:06.159550 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:06.160715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:06.324136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:06.324758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:06.337570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:06.338386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:06.339245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:06.340957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:06.341774 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:06.342596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:06.489690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:06.511538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8e158bef-eb08-4be0-8326-bbb1c1c57d02 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.361996 Aug 09 16:51:06.512280 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 26/66] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:06 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:06.587325 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:06.595930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c0cc97fa-7a71-4b84-98e4-1129bc95b701 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.275689 Aug 09 16:51:06.598498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 41/67] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:06 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:06.943077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:06.944878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:06.953119 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:06.953950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:06.954621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:06.955695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:06.956419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:06.957605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.065117 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:07.066848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:07.073150 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=34 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:07.078052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.078052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.078052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.078052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.078695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.078695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.193355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:07.201205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6f2c8f8c-18a0-412d-b253-f0abc208510a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.264821 Aug 09 16:51:07.203138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 27/68] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:06 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:07.241696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:07.249268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2018fc1d-070d-4282-8beb-8cac9bd0d2e2 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.188071 Aug 09 16:51:07.249876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 42/69] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:07 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:07.461009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c13ec5a-b577-4bed-aa8c-ce73b8391b3c", "tag": "6e84ef22-6ed0-41c2-a430-5a00d8efa76c"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:07.492516 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.497773 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.497773 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.518190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Creating event network-changed:6e84ef22-6ed0-41c2-a430-5a00d8efa76c for instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c on hv-cinder-85236 Aug 09 16:51:07.519057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124901) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 16:51:07.520646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0936e73f-852d-401c-9fa6-d8574998dfd1 req-35aa5d9c-9121-4590-a7b2-c2447fa95769 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124901) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 16:51:07.526622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.527531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.528315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.534333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.534333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.534333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.539764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:07.540430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:07.542210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.compute.rpcapi [None req-da972cad-de65-41df-9270-6f267718a808 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 16:51:07.543131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da972cad-de65-41df-9270-6f267718a808 None None] Releasing lock "compute-rpcapi-router" {{(pid=124901) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 16:51:07.556807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.558274 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.563293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.564475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.564638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-da972cad-de65-41df-9270-6f267718a808 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111205 Aug 09 16:51:07.565242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 28/70] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:07.565557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.566177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.619615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:07.620405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:07.627160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.628531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.628531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.629131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:07.629949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:07.630409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:07.744225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:07.751696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-694e6e6b-506c-4519-ab4e-bcd39e5a5c5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.220543 Aug 09 16:51:07.763782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 43/71] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:07 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:07.815804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:07.825271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-578970b8-ef53-4de2-977d-81b3a081dfbc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.210017 Aug 09 16:51:07.826052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 29/72] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:07 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:08.224041 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:08.224718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:08.233135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.233135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.233607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.234335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.239782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.241456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.248055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:08.279346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:08.279989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:08.292616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.293555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.294166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.295176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.300753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.300753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.458905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:08.469952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b24543c1-d1f0-4fec-9bcc-50553fb6b375 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.248583 Aug 09 16:51:08.472784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 44/73] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:08 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:08.484249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:08.488545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:08.492902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3beead15-b39a-4166-a91e-0c453edeaae8 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.224650 Aug 09 16:51:08.493591 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 30/74] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:08 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:08.774662 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:08.775328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:08.781387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.781896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.782340 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.783048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.784229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.784229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.846486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:08.848086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:08.859488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.864818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.864818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.864818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:08.864818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:08.865208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:08.926496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:08.934277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7ada0eb3-04de-49ea-b5a7-02173e90b2b2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.163269 Aug 09 16:51:08.934858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 45/75] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:08 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:09.006368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:09.013763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-42a83b21-0ed2-4f49-aed0-e35789d28ed1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.171729 Aug 09 16:51:09.014332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 31/76] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:08 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:09.493940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:09.494381 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:09.503161 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:09.508946 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:09.509444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:09.509886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:09.510592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:09.511048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:09.511683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:09.514933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:09.515609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:09.523835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:09.532503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:09.532503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:09.532503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:09.532503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:09.532847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:09.678971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:09.687988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-95356cd5-a17d-424d-af5b-8c4594db5efc tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.198830 Aug 09 16:51:09.688594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 46/77] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:09 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:09.690403 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:09.701543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b1b8614d-12f3-4def-8561-b5bb542c05e9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.188317 Aug 09 16:51:09.702090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 32/78] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:09 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:09.956017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:09.957946 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:09.965213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:09.965836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:09.966344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:09.967418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:09.968081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:09.968602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.035068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:10.035865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:10.042358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:10.042938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:10.043466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.044363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:10.045112 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:10.045731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.192581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:10.200086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e57a4711-29c4-4c6f-94d9-76ca7cd67b5b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.247868 Aug 09 16:51:10.203886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 47/79] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:09 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:10.226360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:10.234828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-90a79b98-41ca-45a6-aae2-639040802a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.204707 Aug 09 16:51:10.235434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 33/80] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:10 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:10.709723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:10.710432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:10.717111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:10.719395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:10.722894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.722894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:10.722894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:10.722894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.724879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:10.725520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:10.731562 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:10.732052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:10.732632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.733338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:10.733797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:10.734474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:10.913425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:10.923494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5548fec1-8a12-4d15-b529-be5e9adf2828 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.217773 Aug 09 16:51:10.924619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 48/81] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:10 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:10.985596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:10.995063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4c0742a8-f259-4173-8fcb-cc18afba5bf4 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.274880 Aug 09 16:51:11.007677 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 34/82] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:10 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:11.228068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:11.229157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:11.237649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:11.238557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:11.239240 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:11.240703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:11.241417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:11.241918 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:11.257041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:11.264422 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:11.267549 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:11.268044 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:11.274508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:11.275521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:11.276264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:11.276866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:11.459444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:11.469307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-569a821a-f01d-4133-a1a3-5c6e8ada2e9d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.249312 Aug 09 16:51:11.478870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 49/83] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:11 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:11.562566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:11.573853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f43d2293-8986-440c-a8d8-7362333dced5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.321254 Aug 09 16:51:11.574649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 35/84] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:11 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:11.954979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:11.955799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:11.964990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:11.965569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:11.966144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:11.966934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:11.967594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:11.968173 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.017605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:12.018141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:12.026812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:12.027712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:12.028344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.029732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:12.030673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:12.031426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.143954 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:12.152913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-49f9b7d5-52ce-4850-9493-124da40f920b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.201953 Aug 09 16:51:12.153868 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 50/85] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:11 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:12.409646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:12.420220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-98809680-2a95-469a-9e5d-26aec69410c1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.406389 Aug 09 16:51:12.421408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 36/86] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:12 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:12.492323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:12.493422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:12.499618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:12.500303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:12.500903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.501762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:12.502360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:12.502928 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.595584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:12.596689 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:12.606964 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:12.608567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:12.610365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.620613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:12.620613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:12.620613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:12.703054 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:12.731233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-49978be6-63bf-4fe1-9bff-86abedafd9cf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.228100 Aug 09 16:51:12.731788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 51/87] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:12 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:12.834638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:12.842489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5aa74e9d-71d2-4af1-adc5-3826b198f1c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.252206 Aug 09 16:51:12.843037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 37/88] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:12 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:13.175213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:13.176895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:13.182755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.183398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.184099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.184835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.185283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.185699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.339248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:13.350451 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7377c947-41d4-4490-a225-78f11b951f5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.179507 Aug 09 16:51:13.359519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 52/89] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:13 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:13.441908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:13.450115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:13.450115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.450115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.450115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.450494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.450720 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.451217 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.601218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:13.608101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c7f89129-f4d4-4e8f-afb6-c976288d35ec tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.170090 Aug 09 16:51:13.608688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 38/90] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:13 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:13.742850 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:13.743563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:13.749657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.750171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.750639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.751353 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.751806 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.752228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.868732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:13.869671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:13.877307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.877923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.879437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.880236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:13.880699 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:13.881130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:13.891893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:13.899292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b83b4d2e-527f-4643-a3ee-201fcdd4dd3c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.160451 Aug 09 16:51:13.899880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 53/91] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:13 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:14.023393 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:14.031037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-99369144-8446-47c9-a6e6-9c7103e070c1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.170166 Aug 09 16:51:14.031628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 39/92] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:13 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:14.373911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:14.373911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:14.379276 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:14.379800 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:14.380355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:14.381162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:14.381612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:14.382187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:14.532998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:14.543019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1c14e9d5-e3df-4a95-a7be-0939b1077991 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.175484 Aug 09 16:51:14.543660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 54/93] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:14 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:14.630009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:14.630678 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:14.636838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:14.637370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:14.637805 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:14.638532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:14.638988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:14.639460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:14.768992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:14.777238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-635bb336-95ff-4ebc-8d72-61a1128e61a3 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.151278 Aug 09 16:51:14.777823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 40/94] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:14 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:14.920317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:14.920991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:14.927906 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:14.928398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:14.928838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:14.929538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:14.929996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:14.930418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:15.054382 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:15.055004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:15.060881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:15.061379 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:15.061871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:15.062309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:15.063003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:15.063564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:15.064432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:15.068899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fe067f18-ba65-44d7-aaab-49ba2974a59f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.152459 Aug 09 16:51:15.069483 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 55/95] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:14 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:15.200114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:15.208318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b38f2278-4dbc-4ead-841c-c587ebdc686f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.158544 Aug 09 16:51:15.208885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 41/96] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:15 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:15.569078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:15.570394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:15.580495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:15.581346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:15.582619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:15.583912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:15.584587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:15.585099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:15.731988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:15.740794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-df22bbbe-3ef1-4b5a-a4fd-73066143f171 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.179035 Aug 09 16:51:15.741392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 56/97] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:15 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:15.799340 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:15.799962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:15.805933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:15.806473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:15.806929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:15.807696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:15.808171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:15.808601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.002587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:16.010112 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bb1a50dc-8fb1-4936-a647-4595d5837c26 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.214875 Aug 09 16:51:16.010687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 42/98] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:15 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:16.089739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:16.090356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:16.098520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:16.099013 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:16.099482 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.100170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:16.100621 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:16.101043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.230258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:16.231031 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:16.266761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:16.266761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:16.266761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.266761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:16.268231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:16.268231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.271044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:16.289767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-17a2bfce-4841-484d-93df-9cdac42f455c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.194953 Aug 09 16:51:16.289767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 57/99] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:16 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:16.387391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:16.397258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-38870ecc-60c1-4180-bfda-a2e916ff10ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.169869 Aug 09 16:51:16.397878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 43/100] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:16 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:16.761191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:16.761932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:16.768097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:16.768582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:16.769019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.769713 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:16.770173 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:16.770602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:16.901737 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:16.909273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-438d8a1e-9605-4114-b0b8-f107d3645efa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.152021 Aug 09 16:51:16.909842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 58/101] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:16 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:17.031481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:17.032076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:17.038211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.038960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.039450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.040160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.040620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.041048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.181634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:17.189798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-83076828-1dee-49cb-b10a-6e651ab6f6a1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.162297 Aug 09 16:51:17.190374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 44/102] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:17 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:17.308383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:17.313166 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:17.320025 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.320743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.320743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.321377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.321833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.322255 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.420303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:17.420958 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:17.427903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.428403 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.428934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.429641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.430105 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.430534 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.463896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:17.472074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-50b45c72-0d11-4b06-8694-7c03cbbc1bf3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.167534 Aug 09 16:51:17.473182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 59/103] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:17 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:17.539415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:17.568759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:17.576185 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-62397f68-ce51-48fc-a529-e452a31285bb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.159765 Aug 09 16:51:17.576756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 45/104] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:17 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:17.930601 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:17.931240 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:17.937542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.938075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.938480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:17.939186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:17.939639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:17.943762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.072279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:18.075654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:18.079938 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-343c2719-b105-499e-ac29-2ca56b0aedaa tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.153460 Aug 09 16:51:18.080514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 60/105] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:17 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:18.217403 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:18.218023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:18.224545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:18.225038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:18.225477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.226168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:18.226628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:18.227055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.357221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:18.366212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6f460297-8075-4fb9-9e02-5e2c2f94c9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.152646 Aug 09 16:51:18.366774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 46/106] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:18 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:18.494709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:18.495367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:18.501503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:18.502065 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:18.502506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.503226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:18.503682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:18.504229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.596555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:18.597179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:18.603402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:18.606547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:18.607707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.608437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:18.608910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:18.609342 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:18.630717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:18.639135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:18.658783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-200c58f5-700e-4205-878d-27c762f1164d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.156910 Aug 09 16:51:18.658783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 61/107] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:18 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:18.761757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:18.769499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-dd53442e-2bec-443d-8e3a-30b70e32ad6c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.176741 Aug 09 16:51:18.771252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 47/108] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:18 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:19.101141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:19.101771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:19.108170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.108649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.109072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.109760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.110204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.110614 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.253060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:19.260496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f7af0a67-01f6-4d20-9bb4-e7f7fa2a1cd4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.163291 Aug 09 16:51:19.261058 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 62/109] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:19 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:19.346154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-ce569a81-99b8-4b39-a150-ea0915c543fb req-a8be7c1e-07c7-441d-a9df-c7af967d8fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d48aed-6528-46cd-a11e-6899591a4a27", "name": "network-vif-plugged", "status": "completed", "tag": "53a24594-3349-4f0d-b4fe-6c7d9baea3f2"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:19.355949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-ce569a81-99b8-4b39-a150-ea0915c543fb req-a8be7c1e-07c7-441d-a9df-c7af967d8fd1 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.356431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-ce569a81-99b8-4b39-a150-ea0915c543fb req-a8be7c1e-07c7-441d-a9df-c7af967d8fd1 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.356864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-ce569a81-99b8-4b39-a150-ea0915c543fb req-a8be7c1e-07c7-441d-a9df-c7af967d8fd1 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.368583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-ce569a81-99b8-4b39-a150-ea0915c543fb req-a8be7c1e-07c7-441d-a9df-c7af967d8fd1 service nova] Creating event network-vif-plugged:53a24594-3349-4f0d-b4fe-6c7d9baea3f2 for instance a4d48aed-6528-46cd-a11e-6899591a4a27 on hv-cinder-85236 Aug 09 16:51:19.373617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-ce569a81-99b8-4b39-a150-ea0915c543fb req-a8be7c1e-07c7-441d-a9df-c7af967d8fd1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094844 Aug 09 16:51:19.374211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 48/110] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:51:19.388172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:19.391145 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:19.395264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.395743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.396174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.396850 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.397297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.397713 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.532383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:19.540335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d4e43beb-7888-4759-9685-ae2c8ab666ea tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.155944 Aug 09 16:51:19.540909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 63/111] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:19 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:19.668281 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:19.668988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:19.675473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.676739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.677204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.677900 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.678435 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.678892 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.793121 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:19.794089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:19.800440 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.802060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.802735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.803971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:19.804649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:19.805636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:19.823950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:19.835545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cc40ac28-e385-4c2f-99ff-4fa6cf5eb67d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.171107 Aug 09 16:51:19.839240 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 49/112] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:19 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:19.983674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:19.993626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-20e76efb-cfdc-4d32-8bd9-a1353a4eaeec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.205869 Aug 09 16:51:19.994207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 64/113] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:19 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:20.281996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:20.282617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:20.289029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:20.289539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:20.290037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:20.291209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:20.291980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:20.292404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:20.523395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:20.531826 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b663edbb-13a1-4e71-a4f4-e7fead9748d6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.253553 Aug 09 16:51:20.532882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 50/114] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:20 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:20.562811 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:20.563457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:20.570038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:20.570520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:20.570955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:20.571665 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:20.572162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:20.572590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:20.753739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:20.762223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f786513f-6a6e-4549-89cc-f96e49165319 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.204170 Aug 09 16:51:20.763661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 65/115] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:20 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:20.858198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:20.859072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:20.866037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:20.866759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:20.867255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:20.868011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:20.868591 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:20.869077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.022881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:21.026238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:21.027966 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:21.039858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-588e9974-7027-499a-be65-eb4002aad927 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.182847 Aug 09 16:51:21.040584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 51/116] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:20 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:21.042845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.043824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.044745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.045696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.046378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.047265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.235590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:21.248530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-00d04109-64dd-4984-9750-6031d56e7be7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.236766 Aug 09 16:51:21.249775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 66/117] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:21 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:21.392545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c8e995-dd9a-483b-9c1a-d9301cf27f1e", "name": "network-vif-plugged", "status": "completed", "tag": "5ad131fe-fddf-4bca-bf02-1713526341b7"}, {"server_uuid": "bad3d121-535f-4a16-b412-574cf5da50e9", "name": "network-vif-plugged", "status": "completed", "tag": "ba04df11-96c3-4666-be53-8af43db1ed2d"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:21.403791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.404273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.404725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.418247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] Creating event network-vif-plugged:5ad131fe-fddf-4bca-bf02-1713526341b7 for instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e on hv-cinder-85236 Aug 09 16:51:21.418788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] Creating event network-vif-plugged:ba04df11-96c3-4666-be53-8af43db1ed2d for instance bad3d121-535f-4a16-b412-574cf5da50e9 on hv-cinder-85236 Aug 09 16:51:21.425344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-bbbc4d43-5f39-4c7b-a84d-8fc03d207810 req-f9e8f4a9-287c-40e8-bb7d-9c149eeb460c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036330 Aug 09 16:51:21.426960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 52/118] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:21.553765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:21.554522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:21.561006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.561588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.562134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.563079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.563650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.563974 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.738853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:21.747650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2c7d22f2-e586-426d-979c-ca4490af62bd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.197984 Aug 09 16:51:21.748842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 67/119] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:21 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:21.787180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:21.787885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:21.802649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.803230 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.803674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.804586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:21.808079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:21.808541 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:21.988940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:21.998771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8f1abd1a-1ee0-40b1-b86f-def4323b2ee5 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.214554 Aug 09 16:51:21.998771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 53/120] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:21 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:22.065471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:22.067464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:22.075691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:22.079358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:22.079358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:22.079358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:22.079358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:22.079948 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:22.267851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:22.275461 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:22.276368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:22.278475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5b4797c4-615a-4ef4-b638-75abd44fee4a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.218623 Aug 09 16:51:22.288808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:22.289303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:22.292457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:22.293115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 68/121] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:22 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:22.294480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:22.295005 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:22.304324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:22.520957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:22.530482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-29134685-71d2-448c-bad1-9b61f6a30fe9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.259179 Aug 09 16:51:22.531413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 54/122] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:22 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:22.770099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:22.770772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:22.776932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:22.777414 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:22.777905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:22.778669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:22.779147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:22.779576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:22.948042 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:22.949326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-be0f2c31-5981-4376-99e2-70860597d88d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.183957 Aug 09 16:51:22.949914 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 69/123] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:22 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:23.020086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:23.020867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:23.027853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.028118 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.028570 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.029347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.029903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.030400 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.208578 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:23.216797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-97b61366-17a8-40cf-9017-cf5216dd4330 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.200869 Aug 09 16:51:23.217391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 55/124] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:23 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:23.302377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:23.302990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:23.309116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.309603 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.310036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.310738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.311225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.311650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.442959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-fc151446-6dfc-4e15-8f68-61066544ad42 req-2bb2c28b-d33b-4b27-9100-9b2e497bb51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a274d0-9d37-4f6f-8a7e-2f223cf42198", "name": "network-vif-plugged", "status": "completed", "tag": "c7c7c2fe-a482-49a1-bef6-cb7da54c233e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:23.450834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:23.464110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c7618b3a-1f30-44b9-a9dd-3af5975f7d9c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.166054 Aug 09 16:51:23.466233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 70/125] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:23 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:23.466454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fc151446-6dfc-4e15-8f68-61066544ad42 req-2bb2c28b-d33b-4b27-9100-9b2e497bb51b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.466692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fc151446-6dfc-4e15-8f68-61066544ad42 req-2bb2c28b-d33b-4b27-9100-9b2e497bb51b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.467338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fc151446-6dfc-4e15-8f68-61066544ad42 req-2bb2c28b-d33b-4b27-9100-9b2e497bb51b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.482261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-fc151446-6dfc-4e15-8f68-61066544ad42 req-2bb2c28b-d33b-4b27-9100-9b2e497bb51b service nova] Creating event network-vif-plugged:c7c7c2fe-a482-49a1-bef6-cb7da54c233e for instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 on hv-cinder-85236 Aug 09 16:51:23.487483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-fc151446-6dfc-4e15-8f68-61066544ad42 req-2bb2c28b-d33b-4b27-9100-9b2e497bb51b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050658 Aug 09 16:51:23.489188 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 56/126] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:51:23.552321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:23.552743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:23.560839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.561655 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.562098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.562817 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.563268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.563973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.725615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:23.744341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cd103e29-aabe-4497-b1fa-cee7a71278f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.196648 Aug 09 16:51:23.748965 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 71/127] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:23 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:23.970279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:23.970978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:23.977163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.977645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.978078 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:23.978766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:23.979249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:23.980434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.135765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:24.144967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-27b35cd0-d159-4ef3-9eed-127c1a3299cb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.178696 Aug 09 16:51:24.145557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 57/128] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:23 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:24.238783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:24.243210 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:24.249341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:24.249828 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:24.250270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.250971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:24.251480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:24.251892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.395122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:24.405285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-00e23d61-115a-43b3-904d-87546a6f13fa tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1315 microversion: 2.1 time: 0.170983 Aug 09 16:51:24.406050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 72/129] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:24 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:24.486754 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:24.487389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:24.493847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:24.494330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:24.494765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.495475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:24.495929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:24.496358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.626680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:24.634769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e30dc891-61ca-4bef-a4a6-49e2ae5cf253 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.151827 Aug 09 16:51:24.635384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 58/130] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:24 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:24.770496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:24.771237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:24.777973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:24.779207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:24.783173 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.784467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:24.786265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:24.786849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:24.991846 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:25.008088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c8184c3d-67c3-4e63-be48-75eb6bbda502 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1321 microversion: 2.1 time: 0.242794 Aug 09 16:51:25.010251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 73/131] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:24 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:25.169134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:25.170704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:25.195694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.195694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.195694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.195694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.196032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.196032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.430169 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:25.431221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:25.436190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:25.437423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.438095 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.438689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.439591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.440260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.440865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.446198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7a301fe1-4fa9-4fed-b721-769d9f65fc2e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.281084 Aug 09 16:51:25.446962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 59/132] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:25 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:25.525249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-19bca5f3-ba6c-4445-9c5f-6d10c9c11601 req-26cdf277-d704-4ffb-8f82-5389acee5941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c13ec5a-b577-4bed-aa8c-ce73b8391b3c", "name": "network-vif-plugged", "status": "completed", "tag": "6e84ef22-6ed0-41c2-a430-5a00d8efa76c"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:25.535920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-19bca5f3-ba6c-4445-9c5f-6d10c9c11601 req-26cdf277-d704-4ffb-8f82-5389acee5941 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.536514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-19bca5f3-ba6c-4445-9c5f-6d10c9c11601 req-26cdf277-d704-4ffb-8f82-5389acee5941 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.537138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-19bca5f3-ba6c-4445-9c5f-6d10c9c11601 req-26cdf277-d704-4ffb-8f82-5389acee5941 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.551912 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-19bca5f3-ba6c-4445-9c5f-6d10c9c11601 req-26cdf277-d704-4ffb-8f82-5389acee5941 service nova] Creating event network-vif-plugged:6e84ef22-6ed0-41c2-a430-5a00d8efa76c for instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c on hv-cinder-85236 Aug 09 16:51:25.558320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-19bca5f3-ba6c-4445-9c5f-6d10c9c11601 req-26cdf277-d704-4ffb-8f82-5389acee5941 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037486 Aug 09 16:51:25.562394 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 60/133] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:51:25.655778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:25.656801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:25.663434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.664263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.664772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.665551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:25.666088 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:25.666611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:25.693490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:25.701293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-20e889a0-4bfb-41ee-bdfe-0cd8465facf9 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1503 microversion: 2.1 time: 0.275046 Aug 09 16:51:25.701879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 74/134] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:25 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:25.826198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:25.838529 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-164fdfb1-0803-481b-94fd-fa0b8e75ae2f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.187538 Aug 09 16:51:25.839666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 61/135] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:25 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:26.030577 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:26.031225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:26.033040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:26.038192 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.038746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.039251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.041647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.042137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.042568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.252364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:26.260690 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-eb19f52e-7a16-44f2-bade-a9658108e424 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1514 microversion: 2.1 time: 0.234130 Aug 09 16:51:26.261273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 75/136] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:26 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:26.290237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:26.293412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:26.306065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.306065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.306065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.306065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.306446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.306446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.405865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'flavor' on Instance uuid bad3d121-535f-4a16-b412-574cf5da50e9 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:51:26.469066 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:26.469803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:26.479468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.479993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.480453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.481202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.482290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.482760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.673847 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:26.684041 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-81893665-f434-4a59-9391-c3c322910ea0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.219606 Aug 09 16:51:26.684837 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 76/137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:26 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:26.872307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b3a93afc-ab1b-47e1-a8fb-1cd1b01a397c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9/action" status: 200 len: 32 microversion: 2.1 time: 0.590343 Aug 09 16:51:26.876016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 62/138] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:51:26 2022] POST /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9/action => generated 32 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 16:51:26.885307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:26.888682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:26.888817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:26.891010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:26.903702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.904213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.904333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.904960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.905576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.906540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.907022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.907503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:26.908031 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.908148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:26.908646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.909596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:26.957456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:27.133887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:27.143280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-db43ed4c-051a-4f91-9a82-b485c5c729a8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.267061 Aug 09 16:51:27.144876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 77/139] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:26 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:27.223676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:27.243016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8f349c92-9983-4b50-a385-d2255a759dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.361171 Aug 09 16:51:27.247916 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 63/140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:26 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:27.705838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:27.707785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:27.724754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:27.724754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:27.724754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:27.726540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:27.727283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:27.728216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:27.758039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a508a1-b10d-4997-82f8-2a19011f2206"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:27.761725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:27.769124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:27.771651 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:27.772311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:27.773220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:27.775842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:27.775842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:27.863569 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:27.933491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:27.941830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bbe68f21-724e-46eb-bb13-6c43852ff2c4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.239345 Aug 09 16:51:27.942406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 78/141] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:27 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:28.164618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:28.165240 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:28.172807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:28.172807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:28.172807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:28.173497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:28.174352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:28.174472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:28.324088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:28.334366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f1f5dfe0-9ca9-4bbb-964b-5f2945160f8c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1364 microversion: 2.1 time: 0.173591 Aug 09 16:51:28.335523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 79/142] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:28 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:28.353900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:28.354730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:28.364530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:28.365368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:28.366390 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:28.367610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:28.368617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:28.369150 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:28.545220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:28.553484 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-18653285-ab7e-4ea7-9287-f9a6433e46c9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.216650 Aug 09 16:51:28.554188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 80/143] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:28 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:28.963719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:28.964458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:28.970642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:28.971318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:28.971985 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:28.972803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:28.973356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:28.973858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.224035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:29.232558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b9758104-8499-405e-96af-6f082f5939be tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.273152 Aug 09 16:51:29.233062 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 81/144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:28 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:29.356660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:29.357657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:29.365040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:29.365706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:29.366142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.367029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:29.367653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:29.368231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.509092 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:29.516799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-928d3c65-813d-41f8-8f04-51a9fe9b59c7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1550 microversion: 2.1 time: 0.163929 Aug 09 16:51:29.517375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 82/145] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:29 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:29.540993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:29.541487 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:29.547586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:29.548157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:29.548640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.549338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:29.549797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:29.550266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.688919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b46b8eed-2881-46fe-9ea3-018768bd2369 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151789 Aug 09 16:51:29.689590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 83/146] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:51:29 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:51:29.694489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:29.695193 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:29.701827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:29.702444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:29.703121 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.703985 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:29.704774 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:29.705302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:29.882409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:29.891466 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b22aa75e-1683-4f76-b393-dfb60200255d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.200398 Aug 09 16:51:29.892068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 84/147] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:29 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:29.920308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a334c21f-3e15-4638-8ab2-eb5efbb98ad1 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "POST /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.151827 Aug 09 16:51:29.920308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 64/148] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:51:27 2022] POST /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e/os-volume_attachments => generated 194 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:51:30.256283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:30.257242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:30.264647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:30.265407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:30.265982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:30.266896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:30.267718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:30.268296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:30.608593 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:30.616092 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1fcf2ce1-b10a-4665-9aed-8fe250dbf78b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1367 microversion: 2.1 time: 0.364580 Aug 09 16:51:30.616660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 85/149] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:30 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:30.918379 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:30.919144 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:30.927888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:30.928526 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:30.928906 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:30.929907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:30.930368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:30.930796 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:31.450314 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:31.461441 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b149c979-f961-444e-8a2c-d468854940fa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.547303 Aug 09 16:51:31.462938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 65/150] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:30 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:31.637993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:31.639421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:31.646726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:31.647444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:31.647886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:31.649510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:31.649970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:31.650397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:31.733983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-1a8bd981-6109-4452-aed9-09450eea0120 req-bb5687dc-a692-4630-b960-be0447cf3117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a274d0-9d37-4f6f-8a7e-2f223cf42198", "tag": "c7c7c2fe-a482-49a1-bef6-cb7da54c233e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:31.745099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-1a8bd981-6109-4452-aed9-09450eea0120 req-bb5687dc-a692-4630-b960-be0447cf3117 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:31.745742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-1a8bd981-6109-4452-aed9-09450eea0120 req-bb5687dc-a692-4630-b960-be0447cf3117 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:31.746232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-1a8bd981-6109-4452-aed9-09450eea0120 req-bb5687dc-a692-4630-b960-be0447cf3117 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:31.762008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-1a8bd981-6109-4452-aed9-09450eea0120 req-bb5687dc-a692-4630-b960-be0447cf3117 service nova] Creating event network-changed:c7c7c2fe-a482-49a1-bef6-cb7da54c233e for instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 on hv-cinder-85236 Aug 09 16:51:31.788787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-1a8bd981-6109-4452-aed9-09450eea0120 req-bb5687dc-a692-4630-b960-be0447cf3117 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058655 Aug 09 16:51:31.795802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 66/151] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:51:31.813146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:31.824516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3abcaeda-c5eb-4b58-a7f6-60bfaef3d0e1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1557 microversion: 2.1 time: 0.190606 Aug 09 16:51:31.825432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 86/152] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:31 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:31.846530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:31.847510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:31.853545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:31.855354 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:31.855908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:31.856785 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:31.857311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:31.857807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:31.960634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7379d2a4-2bfa-456c-8503-6d43110fabdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118106 Aug 09 16:51:31.961387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 67/153] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:51:31 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:32.490552 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:32.491582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:32.497788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:32.498642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:32.506595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:32.506595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:32.506595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:32.506595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:32.834098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:32.842336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ecae9a64-be00-4321-811e-83329db0f112 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.356045 Aug 09 16:51:32.842922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 87/154] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:32 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:33.421137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-4aa0396e-a913-4cc8-80b3-ff0631cfc782 req-164dc486-4053-47bb-ad6e-7f4980f3a3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c13ec5a-b577-4bed-aa8c-ce73b8391b3c", "tag": "6e84ef22-6ed0-41c2-a430-5a00d8efa76c"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:33.432383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4aa0396e-a913-4cc8-80b3-ff0631cfc782 req-164dc486-4053-47bb-ad6e-7f4980f3a3fe service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:33.432884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4aa0396e-a913-4cc8-80b3-ff0631cfc782 req-164dc486-4053-47bb-ad6e-7f4980f3a3fe service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:33.433536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4aa0396e-a913-4cc8-80b3-ff0631cfc782 req-164dc486-4053-47bb-ad6e-7f4980f3a3fe service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:33.447283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-4aa0396e-a913-4cc8-80b3-ff0631cfc782 req-164dc486-4053-47bb-ad6e-7f4980f3a3fe service nova] Creating event network-changed:6e84ef22-6ed0-41c2-a430-5a00d8efa76c for instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c on hv-cinder-85236 Aug 09 16:51:33.468152 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-4aa0396e-a913-4cc8-80b3-ff0631cfc782 req-164dc486-4053-47bb-ad6e-7f4980f3a3fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051384 Aug 09 16:51:33.469005 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 68/155] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:33.864006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:33.864631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:33.870898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:33.871438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:33.871863 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:33.872558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:33.873186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:33.873612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:34.029657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:34.040738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c8765196-fef8-4eab-b377-a713249dc65d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.180575 Aug 09 16:51:34.041401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 88/156] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:33 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:35.065409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:35.066190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:35.068270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=95 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:35.074507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:35.075010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:35.075543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:35.076347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:35.076809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:35.077237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:35.233559 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:35.241636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6c01a3c9-8a1b-45b7-9657-c02481ff456b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.181075 Aug 09 16:51:35.242258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 69/157] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:35 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:36.265202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:36.265818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:36.272958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:36.273423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:36.273857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:36.274555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:36.274992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:36.276007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:36.446892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:36.454543 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dd459b53-114b-48d2-94f2-3363026386d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.194584 Aug 09 16:51:36.455522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 89/158] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:36 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:37.475955 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:37.476570 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:37.488808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:37.488808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:37.488808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:37.488808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:37.489122 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:37.489122 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:37.630130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:37.637599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fa5a63a8-88d4-4ba9-b873-6ef6fd60cf13 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.165757 Aug 09 16:51:37.638171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 70/159] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:37 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:38.657883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:38.658493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:38.664520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:38.665002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:38.665433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:38.666118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:38.666636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:38.667060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:38.798820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:38.806568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e348d8cb-0ae5-4c7a-8aab-2cdab9236722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.152393 Aug 09 16:51:38.807183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 90/160] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:38 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:39.829053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:39.829593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:39.836786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:39.837291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:39.837724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:39.838410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:39.838859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:39.839312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:39.973980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:39.981451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-28f8523e-399b-4f83-933d-d8b2b467c6d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.156332 Aug 09 16:51:39.982016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 71/161] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:39 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:41.002685 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:41.003329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:41.012821 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:41.013677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:41.014078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:41.014823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:41.015635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:41.015924 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:41.344669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:41.354622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-59a0abf6-7d45-431a-a737-be3f7dafb174 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.355714 Aug 09 16:51:41.355221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 91/162] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:40 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:42.375427 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:42.376166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:42.383465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:42.383956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:42.384435 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:42.385133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:42.385585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:42.386006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:42.542290 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:42.550326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-57bad8e0-16a2-4013-b4bc-9d721c3ca6f0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.178652 Aug 09 16:51:42.550999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 72/163] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:42 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:43.571771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:43.572362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:43.578347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:43.578823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:43.579286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:43.579976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:43.580427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:43.580846 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:43.720391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:43.728895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f6f453e7-8a68-423f-9a2d-0b7d18d0b7d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.161088 Aug 09 16:51:43.729479 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 92/164] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:43 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:44.749888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:44.750846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:44.757965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:44.758454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:44.758889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:44.759636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:44.760094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:44.760521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:44.894973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:44.902791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a9b04b2a-0604-4380-ba9f-428b339051b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.156793 Aug 09 16:51:44.903410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 73/165] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:44 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:45.923317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:45.924006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:45.930511 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:45.931328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:45.931977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:45.933027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:45.933930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:45.934362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:46.137288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:46.145971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1c8581c0-eded-4dd7-8c85-a81081e5bf56 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.226176 Aug 09 16:51:46.145971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 93/166] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:45 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:47.168447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:47.169555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:47.189111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:47.190225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:47.190885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:47.191858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:47.193495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:47.194321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:47.343749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:47.352298 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b64f799b-b9b6-463b-9811-4429b57b307e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.188805 Aug 09 16:51:47.352881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 74/167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:47 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:51:48.373324 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:48.374089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:48.380885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:48.382415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:48.382415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:48.382633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:48.383083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:48.383571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:48.403025 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:48.538862 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:48.547677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7cd11bd6-871a-4c80-b2fd-51d5cf4e33b9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.178289 Aug 09 16:51:48.548915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 94/168] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:48 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:49.569229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:49.569845 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:49.576303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:49.576873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:49.577312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:49.578032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:49.578489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:49.578917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:49.782271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:49.790454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8858835b-8ba8-40b2-aeab-acf8d476e768 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.225214 Aug 09 16:51:49.791314 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 75/169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:49 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:50.812282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:50.813586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:50.822250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:50.823233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:50.824091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:50.825288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:50.825927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:50.826691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:50.998420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:51.003406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c304ae48-7467-4f45-8988-890736f35cc4 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.195105 Aug 09 16:51:51.019182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 95/170] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:50 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:52.028715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:52.029463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:52.035750 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:52.039190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:52.039190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:52.039190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:52.039190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:52.039596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:52.190476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:52.198525 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3fd1575b-18af-4e93-84ea-ff8a00e206dd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.173525 Aug 09 16:51:52.199139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 76/171] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:52 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:53.220783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:53.222261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:53.240689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:53.241441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:53.242064 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:53.242932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:53.243564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:53.244141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:53.407405 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:53.425155 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7322745b-b9be-45a9-ba51-1764d27a97cc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.202164 Aug 09 16:51:53.426307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 96/172] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:53 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:53.520176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:53.520718 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:53.528249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:53.528811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:53.529249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:53.530098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:53.530545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:53.530963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:53.560225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:51:53.958330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-72aae234-804a-4ec3-89d3-179156c22d09 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 204 len: 0 microversion: 2.1 time: 0.441757 Aug 09 16:51:53.958940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 77/173] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:51:53 2022] DELETE /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:51:53.977037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:53.977728 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:53.983644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:53.984125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:53.984554 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:53.985234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:53.985686 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:53.986111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:54.125975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:54.134640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bdf23805-b519-44a4-9cd7-f3b3df8b589b tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1555 microversion: 2.1 time: 0.161559 Aug 09 16:51:54.135247 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 97/174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:53 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:54.453754 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:54.454372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:54.460491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:54.460980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:54.461486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:54.462183 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:54.462639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:54.467962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:54.628038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:54.636691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-90028168-89a4-4938-ad5b-e3a12fd90b2d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.187224 Aug 09 16:51:54.637275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 78/175] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:54 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:55.157927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:55.157927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:55.164503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:55.164989 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:55.165420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:55.166109 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:55.166648 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:55.167002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:55.335446 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:55.346183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-14b441dd-4d1d-4f57-84e7-49972849ae66 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1555 microversion: 2.1 time: 0.193894 Aug 09 16:51:55.347206 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 98/176] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:55 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:55.657638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:55.658551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:55.665932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:55.666737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:55.667279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:55.668063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:55.668549 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:55.669159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:55.855090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:55.863535 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-adfdd7aa-3669-46f6-8a3f-34729b18c873 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.209569 Aug 09 16:51:55.864716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 79/177] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:55 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:56.374603 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:56.375608 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:56.384493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:56.385202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:56.385970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:56.386633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:56.387256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:56.387678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:56.677203 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:56.685805 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c51320fc-7ba2-495e-9b1d-38571de4f11d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1555 microversion: 2.1 time: 0.316108 Aug 09 16:51:56.686412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 99/178] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:56 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1555 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:56.889049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:56.893651 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:56.907791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:56.909333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:56.910012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:56.912072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:56.914610 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:56.915330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:56.927497 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:57.267180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:57.280741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3e4d9937-5510-4fb5-9641-c662ec63570f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.397282 Aug 09 16:51:57.282197 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 80/179] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:56 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:57.707231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:57.708362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:57.728259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-4b5738b1-0f91-4d98-8cff-6cb6c9e93d9b req-8b65653e-2fab-466f-a4fb-9b972005391c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c8e995-dd9a-483b-9c1a-d9301cf27f1e", "name": "network-vif-deleted", "tag": "5ad131fe-fddf-4bca-bf02-1713526341b7"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:51:57.728399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=50 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:57.728399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:57.728399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:57.728399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:57.728718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:57.728718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:57.729080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:57.743273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4b5738b1-0f91-4d98-8cff-6cb6c9e93d9b req-8b65653e-2fab-466f-a4fb-9b972005391c service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:57.744197 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4b5738b1-0f91-4d98-8cff-6cb6c9e93d9b req-8b65653e-2fab-466f-a4fb-9b972005391c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:57.744828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4b5738b1-0f91-4d98-8cff-6cb6c9e93d9b req-8b65653e-2fab-466f-a4fb-9b972005391c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:57.768694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-4b5738b1-0f91-4d98-8cff-6cb6c9e93d9b req-8b65653e-2fab-466f-a4fb-9b972005391c service nova] Creating event network-vif-deleted:5ad131fe-fddf-4bca-bf02-1713526341b7 for instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e on hv-cinder-85236 Aug 09 16:51:57.800617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-4b5738b1-0f91-4d98-8cff-6cb6c9e93d9b req-8b65653e-2fab-466f-a4fb-9b972005391c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060251 Aug 09 16:51:57.802259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 81/180] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:51:57.873456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:57.884102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bd805e2e-4b4c-4711-8705-85eb25ee0a3d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1513 microversion: 2.1 time: 0.180668 Aug 09 16:51:57.884691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 100/181] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:57 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:58.305995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:58.306590 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:58.316539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:58.317179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:58.317852 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:58.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:58.320197 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:58.320624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:58.592235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:58.604545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3aa1bc90-590f-48f0-9d1c-a647ba06f3a6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.304255 Aug 09 16:51:58.608814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 82/182] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:58 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:58.919943 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:58.922336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:58.949907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:58.949907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:58.949907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:58.952419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:58.953106 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:58.953792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:59.001220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:59.001744 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:59.002299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:59.002921 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lazy-loading 'fault' on Instance uuid 10c8e995-dd9a-483b-9c1a-d9301cf27f1e {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:51:59.081852 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb77041409e4caa81b4acac46464af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4533225c6c3147308e6bfbc4a7fbf788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:59.116383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-21033251-835e-4a02-91ff-8d6f6ad2bc02 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 200 len: 1351 microversion: 2.1 time: 0.208688 Aug 09 16:51:59.123477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 101/183] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:58 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 1351 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:51:59.630765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:51:59.632606 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:51:59.648487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:59.650099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:59.650797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:59.651741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:51:59.652611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:51:59.653256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:51:59.840793 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:51:59.856488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3f0ec1be-2bd0-427e-800a-9dd7ae8ec0cb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.230089 Aug 09 16:51:59.857155 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 83/184] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:51:59 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:00.144194 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:00.146084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:00.153132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:00.153912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:00.154618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:00.155683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:00.156423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:00.157331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:00.185069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] HTTP exception thrown: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Request method failure captured: Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e HTTP/1.1 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBimHUa2CAon-jeJGo0csIogEIiVYTAUetH4KPqBaGLLF0TiHvS5w7AA_3JukpxL9CSHJqG9Xx55-6n5O53ruO-X61lQpLmQGLHIX5zFSnPogRhBKN3nq3H5p4w_w5zXGnUZ36W_HRjmhSebqL33isDj9w6sK5LSCqSOw9MsHVNVm8 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:52:00.207940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4533225c6c3147308e6bfbc4a7fbf788", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}] Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: cbb77041409e4caa81b4acac46464af1 Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.209209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '10c8e995-dd9a-483b-9c1a-d9301cf27f1e'} Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:52:00.209904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.211272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.212294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Returning 404 to user: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:52:00.212294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c6a7b709-3cc1-4944-91e8-26b9681922d0 tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 404 len: 111 microversion: 2.1 time: 0.069374 Aug 09 16:52:00.223851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 102/185] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:00 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:52:00.361700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:00.366946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:00.374081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:00.374784 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:00.375418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:00.376338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:00.376791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:00.377369 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:00.390879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] HTTP exception thrown: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Request method failure captured: Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e/os-volume_attachments HTTP/1.1 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBimHUa2CAon-jeJGo0csIogEIiVYTAUetH4KPqBaGLLF0TiHvS5w7AA_3JukpxL9CSHJqG9Xx55-6n5O53ruO-X61lQpLmQGLHIX5zFSnPogRhBKN3nq3H5p4w_w5zXGnUZ36W_HRjmhSebqL33isDj9w6sK5LSCqSOw9MsHVNVm8 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:52:00.401609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4533225c6c3147308e6bfbc4a7fbf788", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}] Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: cbb77041409e4caa81b4acac46464af1 Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.403173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'server_id': '10c8e995-dd9a-483b-9c1a-d9301cf27f1e'} Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:52:00.404018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:00.407245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:00.424234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Returning 404 to user: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:52:00.434371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f225d504-1248-4414-8a14-83d6c17261da tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063116 Aug 09 16:52:00.435709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 84/186] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:52:00 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:52:00.881000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:00.881923 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:00.905493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:00.905493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:00.905493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:00.905493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:00.907379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:00.907379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:01.182817 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:01.192110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7c3abc1e-c95a-4920-97b0-a36cabf2833c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.317813 Aug 09 16:52:01.206472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 103/187] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:00 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:02.213425 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:02.214046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:02.220926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:02.221770 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:02.222387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:02.223153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:02.223759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:02.224143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:02.515653 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:02.536501 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-63346382-eb33-4553-84f0-5d2777c4f16b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.327686 Aug 09 16:52:02.539475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 85/188] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:02 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:03.560165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:03.560847 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:03.569968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:03.570585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:03.571021 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:03.571934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:03.572442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:03.572865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:03.835225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:03.845047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-30dc73e1-6752-4821-9b05-cf1255d237a1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.290148 Aug 09 16:52:03.845960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 104/189] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:03 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:04.868373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:04.869781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:04.880619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:04.885249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:04.885249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:04.885249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:04.885249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:04.885640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:05.056963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:05.065185 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b50728a1-317f-42ad-8a21-f366dc76c39b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.201139 Aug 09 16:52:05.065977 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 86/190] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:04 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:05.234270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:05.234270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:05.236939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:05.237441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:05.237861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:05.238549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:05.238995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:05.240262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:05.270846 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] HTTP exception thrown: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Request method failure captured: Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e HTTP/1.1 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBimHUa2CAon-jeJGo0csIogEIiVYTAUetH4KPqBaGLLF0TiHvS5w7AA_3JukpxL9CSHJqG9Xx55-6n5O53ruO-X61lQpLmQGLHIX5zFSnPogRhBKN3nq3H5p4w_w5zXGnUZ36W_HRjmhSebqL33isDj9w6sK5LSCqSOw9MsHVNVm8 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:52:05.273149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4533225c6c3147308e6bfbc4a7fbf788", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}] Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: cbb77041409e4caa81b4acac46464af1 Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.274726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '10c8e995-dd9a-483b-9c1a-d9301cf27f1e'} Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:52:05.275693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.277103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.278831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Returning 404 to user: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:52:05.278831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-468b5a95-666c-4a71-8432-887d9adaa9ff tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 404 len: 111 microversion: 2.1 time: 0.048107 Aug 09 16:52:05.278831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 105/191] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:52:05 2022] DELETE /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:52:05.289061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:05.289698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] [instance: 10c8e995-dd9a-483b-9c1a-d9301cf27f1e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:05.296210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:05.301451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:05.305662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:05.305662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:05.305662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:05.305662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:05.305971 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:05.343017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] HTTP exception thrown: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Request method failure captured: Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e HTTP/1.1 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBimHUa2CAon-jeJGo0csIogEIiVYTAUetH4KPqBaGLLF0TiHvS5w7AA_3JukpxL9CSHJqG9Xx55-6n5O53ruO-X61lQpLmQGLHIX5zFSnPogRhBKN3nq3H5p4w_w5zXGnUZ36W_HRjmhSebqL33isDj9w6sK5LSCqSOw9MsHVNVm8 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:52:05.345488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4533225c6c3147308e6bfbc4a7fbf788"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4533225c6c3147308e6bfbc4a7fbf788", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4533225c6c3147308e6bfbc4a7fbf788"}]}] Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 4533225c6c3147308e6bfbc4a7fbf788 Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-DeleteServersTestJSON-2075719756 Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: cbb77041409e4caa81b4acac46464af1 Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-DeleteServersTestJSON-2075719756-project Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.346675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '10c8e995-dd9a-483b-9c1a-d9301cf27f1e'} Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:52:05.347359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. Aug 09 16:52:05.348565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:52:05.351261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] Returning 404 to user: Instance 10c8e995-dd9a-483b-9c1a-d9301cf27f1e could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:52:05.352307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ca1924d1-331f-4c61-8438-09d2a412eb0d tempest-DeleteServersTestJSON-2075719756 tempest-DeleteServersTestJSON-2075719756-project] 10.222.0.59 "GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e" status: 404 len: 111 microversion: 2.1 time: 0.071055 Aug 09 16:52:05.353370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 87/192] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:05 2022] GET /compute/v2.1/servers/10c8e995-dd9a-483b-9c1a-d9301cf27f1e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:52:06.094642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:06.099890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:06.124623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:06.124623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:06.124623 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:06.125779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:06.132243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:06.133028 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:06.398673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:06.406203 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d29bba0b-6a59-4448-aee8-dc2d37a55a8a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.322293 Aug 09 16:52:06.406782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 106/193] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:06 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:07.428861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:07.444576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:07.488452 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:07.489219 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:07.489799 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:07.495683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:07.497372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:07.497372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:08.265161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:08.277831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e52c5a11-8116-489e-a18a-2c08c6c0af1b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.854351 Aug 09 16:52:08.282752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 88/194] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:07 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:09.310059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:09.311501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:09.318268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:09.319485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:09.320201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:09.320716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:09.321291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:09.321723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:09.916544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:09.925158 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fc2b270c-6946-4b47-8c3e-278e4a9a99ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.620105 Aug 09 16:52:09.925779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 107/195] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:09 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:10.950261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:10.951695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:10.980664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:10.982624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:10.983657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:10.985332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:10.986117 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:10.986757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:11.237770 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:11.248092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1442045b-66bb-4d7a-af31-27071747f0c2 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.303847 Aug 09 16:52:11.249467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 89/196] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:10 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:12.271045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:12.271696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:12.282546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:12.283330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:12.283927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:12.284828 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:12.285436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:12.286015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:12.578742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:12.588678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e4424d4f-96ab-4495-9681-28379b86aef5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.322147 Aug 09 16:52:12.589678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 108/197] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:12 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:13.614134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:13.614775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:13.629834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:13.630331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:13.631226 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:13.632802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:13.633622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:13.634220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:13.823326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:13.833942 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-60dae7d7-d7df-492b-bdff-aa3419c44dad tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.224868 Aug 09 16:52:13.836148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 90/198] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:13 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:14.166048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2da2d7d6-ca7f-4071-b30d-e982b3bcdda5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Action: 'create', calling method: .version_select at 0x7fccc4ec0820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-983199229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKsIj8i8S+TlTYSvqnKtWgFx7PZL5gcpJBY2lvxcoe3eK8RfGYdaaUvgFnXZwWLc6E7ktrdrUQp4OVq6MIWGF8O1I6EKLJtQcSBi6w6wIHFB/6iAWrwr0FKrlh8NLTtVw=="}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:14.199338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-2da2d7d6-ca7f-4071-b30d-e982b3bcdda5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:14.204604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-2da2d7d6-ca7f-4071-b30d-e982b3bcdda5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for user 02b21bed2f2d4e58b3759349331d44c7 and project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:14.315088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2da2d7d6-ca7f-4071-b30d-e982b3bcdda5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.465783 Aug 09 16:52:14.315899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 109/199] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:52:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:52:14.856285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:14.856892 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:14.863297 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:14.863854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:14.864284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:14.864978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:14.865431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:14.866391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:15.079517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:15.088654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1b67eb05-2e3a-4ff2-97e3-35a6e8ebb2c7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.236176 Aug 09 16:52:15.089247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 91/200] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:14 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:16.110402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:16.111654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:16.120398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:16.121134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:16.121765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:16.122710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:16.123787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:16.124523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:16.402416 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:16.422445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c0c06853-b341-41a1-9503-16e1bba7e48c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1520 microversion: 2.1 time: 0.311197 Aug 09 16:52:16.423697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 110/201] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:16 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:17.444664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:17.447153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:17.504587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:17.508355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:17.511797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:17.513992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:17.518594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:17.523022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:17.811234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:17.821664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-990dd846-c9e8-4008-a0a8-10dc9eb13dac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1500 microversion: 2.1 time: 0.381606 Aug 09 16:52:17.825762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 92/202] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:17 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1500 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:17.849396 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:17.850775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:17.856913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:17.857399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:17.857825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:17.858522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:17.858971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:17.859418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:18.353651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:18.369788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ed59b7e8-0712-4cc8-8183-a49a7f686b4d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1516 microversion: 2.1 time: 0.523393 Aug 09 16:52:18.369788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 111/203] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:17 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1516 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:19.165766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:19.166385 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:19.176286 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:19.176788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:19.183735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:19.185749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:19.186444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:19.188564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:19.227788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e7d306b9-f42e-4e45-816e-e082fc2b42bb tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/ips" status: 200 len: 146 microversion: 2.1 time: 0.066448 Aug 09 16:52:19.228857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 93/204] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:52:19 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/ips => generated 146 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:52:21.605502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:21.610365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:21.617585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:21.618079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:21.618728 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:21.619471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:21.620101 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:21.620698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:21.624682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=93 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:21.645978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'flavor' on Instance uuid a4d48aed-6528-46cd-a11e-6899591a4a27 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:52:21.995951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ddc36621-2c2f-4b0a-a251-397f16dde901 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/action" status: 200 len: 32 microversion: 2.1 time: 0.394524 Aug 09 16:52:21.997447 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 112/205] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:52:21 2022] POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 16:52:22.007224 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:22.007851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:22.018940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:22.018940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:22.018940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:22.018940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:22.019535 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:22.019535 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:22.234382 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:22.249905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d60c7fec-29b0-4c23-b59a-12cc637ca7cf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.246585 Aug 09 16:52:22.255320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 94/206] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:22 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:23.129090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3d262c7f-fc02-48de-ab3c-cc24fc77333f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'create', calling method: .version_select at 0x7fccc4edf310>, body: {"keypair": {"name": "tempest-keypair-1183100428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAuXtS0AHp/qPnymxiZ/wS/tE6hLVyX6gxsfwENvD2oSAv9A999D9L/qHoqyG0LFgTYSSn8TGc+w3bJYrzhHTSHdad+q4GPL1ZZdyQg9UTflQ/TPZmH1s4XwoNQu21Bmw=="}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:23.145489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-3d262c7f-fc02-48de-ab3c-cc24fc77333f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:23.150870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-3d262c7f-fc02-48de-ab3c-cc24fc77333f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for user 35d14469e54946bdb18bafbbed738f37 and project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:23.270945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:23.271591 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:23.282068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:23.282068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:23.282068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:23.282068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:23.282866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:23.282866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:23.296658 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3d262c7f-fc02-48de-ab3c-cc24fc77333f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.493431 Aug 09 16:52:23.298932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 113/207] 10.222.0.59 () {62 vars in 1200 bytes} [Tue Aug 9 16:52:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 496 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 16:52:23.464428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:23.472513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-de2ba767-ad65-4d6f-b320-0c39a89e410c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.205399 Aug 09 16:52:23.473210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 95/208] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:23 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:24.495636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:24.496371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:24.506156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:24.507428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:24.507853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:24.508987 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:24.509449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:24.510470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:24.739083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:24.749189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-be09c3a5-1829-4317-895f-41e269c34994 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.259060 Aug 09 16:52:24.749767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 114/209] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:24 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:24.843538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "301fc146-4fc9-4771-994e-48c21d11b2b2"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:24.845846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:24.853433 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:24.854171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:24.854776 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:24.855587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:24.856046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:24.856475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:25.775491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:25.775491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:25.782922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:25.783792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:25.784532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:25.785309 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:25.785984 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:25.786473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:25.888721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-49956aca-8d72-4e5d-a511-f539e0ed8bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049053 Aug 09 16:52:25.889723 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 96/210] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:52:24 2022] POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-volume_attachments => generated 194 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:52:25.910596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-725111980", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fdb2410-afc4-41b9-b8f9-2ac596eb2296"}], "security_groups": [{"name": "tempest-securitygroup--1496721591"}], "key_name": "tempest-keypair-1183100428", "user_data": "}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:25.989924 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:25.995466 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b2ab8110-761c-4481-848a-20e97c026241 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.226970 Aug 09 16:52:26.007336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 115/211] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:25 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:27.018062 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:27.019467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:27.025839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:27.026472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:27.027312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:27.028223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:27.034321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:27.035486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:27.202759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:27.211362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-24011f01-7d63-43fe-9f29-271edb671310 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.197312 Aug 09 16:52:27.213847 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 116/212] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:27 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:28.235932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:28.235932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:28.240959 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:28.241811 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:28.242384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:28.243752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:28.244763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:28.245321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:28.382456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:28.389979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1253bee9-c799-4580-a85a-7610f9921edf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.160938 Aug 09 16:52:28.390544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 117/213] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:28 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:28.514199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] validate_networks() for [('2fdb2410-afc4-41b9-b8f9-2ac596eb2296', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:52:28.786141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:28.787305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:28.795590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:28.796085 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:28.796520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:28.797224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:28.797679 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:28.798103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:28.823699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e7b14938-0b96-4dd7-97c0-a4cafc325798 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/ips" status: 200 len: 150 microversion: 2.1 time: 0.042549 Aug 09 16:52:28.824489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 118/214] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:52:28 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:52:28.894968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:52:28.895420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:52:28.899424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:52:28.899424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:52:28.899424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:52:28.907202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:28.908069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:28.908716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:28.909676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:28.910364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:28.910963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:28.919010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:28.930901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:28.935339 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for user 35d14469e54946bdb18bafbbed738f37 and project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:28.951000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:52:28.951000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:52:29.080819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-176b4e92-8843-4f8f-bddb-ecfc4fafeafe tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.189824 Aug 09 16:52:29.081477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 97/215] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Aug 9 16:52:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 3191 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 16:52:29.093626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a29e695c-9aa6-41fd-bca9-9e1a5f7d0aa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:29.094266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a29e695c-9aa6-41fd-bca9-9e1a5f7d0aa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:29.096485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:29.171031 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a29e695c-9aa6-41fd-bca9-9e1a5f7d0aa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:29.176884 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a29e695c-9aa6-41fd-bca9-9e1a5f7d0aa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:29.178532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a29e695c-9aa6-41fd-bca9-9e1a5f7d0aa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:29.179712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a29e695c-9aa6-41fd-bca9-9e1a5f7d0aa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1281 microversion: 2.20 time: 0.090304 Aug 09 16:52:29.180273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 119/216] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:29 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:29.412415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:29.413030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:29.421187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:29.421675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:29.422111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:29.422810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:29.423295 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:29.423727 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:29.558606 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:29.566393 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-60951f08-6d4c-4435-a071-1294de9a67ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.158228 Aug 09 16:52:29.566994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 98/217] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:29 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:30.205287 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-929b3418-69ce-4dc9-ad1d-e0278fb56ec3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:30.205927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-929b3418-69ce-4dc9-ad1d-e0278fb56ec3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:30.261239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-929b3418-69ce-4dc9-ad1d-e0278fb56ec3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:30.271520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-929b3418-69ce-4dc9-ad1d-e0278fb56ec3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:30.273765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-929b3418-69ce-4dc9-ad1d-e0278fb56ec3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:30.275197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-929b3418-69ce-4dc9-ad1d-e0278fb56ec3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1281 microversion: 2.20 time: 0.074283 Aug 09 16:52:30.275756 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 120/218] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:30 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:30.588285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:30.588904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:30.595573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:30.596055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:30.596489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:30.597170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:30.597622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:30.598046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:30.750198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:30.758423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f83751d3-4a77-49cd-9df5-37d3cb1d8a54 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.175010 Aug 09 16:52:30.758801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 99/219] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:30 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:30.884067 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b58234-eabf-47d3-b515-bbf849158dd5"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:30.886467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:30.892778 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:30.893267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:30.893705 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:30.894413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:30.894894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:30.895359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:31.298450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:31.299162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:31.305639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:31.306252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:31.306811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:31.307656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:31.308075 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:31.308514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:31.396048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:31.405289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:31.406837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:31.407983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ee0fa03b-5a7e-4813-870b-96ba569463f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1333 microversion: 2.20 time: 0.113498 Aug 09 16:52:31.408543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 100/220] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:31 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:52:31.780055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:31.780862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:31.787210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:31.787895 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:31.788676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:31.789577 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:31.790177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:31.790761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:31.848631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-14121842-daf2-4557-9f94-47f184442a0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.968706 Aug 09 16:52:31.850029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 121/221] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:52:30 2022] POST /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments => generated 194 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:52:31.949182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:31.956895 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2ace8c37-6a89-4d96-a05f-feff6aac2ef3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.180713 Aug 09 16:52:31.957525 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 101/222] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:31 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:32.432889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:32.434675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:32.448220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:32.448717 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:32.449153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:32.449865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:32.450323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:32.450739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:32.542137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:32.553111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:32.554689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:32.555890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-44d70a63-a721-4981-986f-89fed50a8ee3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1339 microversion: 2.20 time: 0.127999 Aug 09 16:52:32.556450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 122/223] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:32 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1339 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:32.981033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:32.981709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:32.989137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:32.990910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:32.991565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:32.992509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:32.993498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:32.998125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:33.178645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:33.186933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-edff3242-8e3b-4e81-8339-0884433deae8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.209760 Aug 09 16:52:33.187696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 102/224] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:32 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:33.587252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:33.587252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:33.589622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:33.590725 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:33.603744 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:33.604659 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:33.605590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:33.605767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:33.913031 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:33.922242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:33.924204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:33.926080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5ca9df55-1ff5-4380-a77d-854a2e4ba32a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.350748 Aug 09 16:52:33.926818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 123/225] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:33 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:34.207507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:34.208126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:34.215028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:34.215543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:34.215981 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:34.216709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:34.217162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:34.217588 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:34.325114 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-7fd4d358-38a2-4142-968e-fd1f4a4da937 req-6485468e-e3df-427a-a9de-5341a90f04f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:34.344703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7fd4d358-38a2-4142-968e-fd1f4a4da937 req-6485468e-e3df-427a-a9de-5341a90f04f3 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:34.345654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7fd4d358-38a2-4142-968e-fd1f4a4da937 req-6485468e-e3df-427a-a9de-5341a90f04f3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:34.346952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7fd4d358-38a2-4142-968e-fd1f4a4da937 req-6485468e-e3df-427a-a9de-5341a90f04f3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:34.368786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-7fd4d358-38a2-4142-968e-fd1f4a4da937 req-6485468e-e3df-427a-a9de-5341a90f04f3 service nova] Creating event network-changed:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:52:34.402526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-7fd4d358-38a2-4142-968e-fd1f4a4da937 req-6485468e-e3df-427a-a9de-5341a90f04f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085015 Aug 09 16:52:34.404256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 124/226] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:52:34.421986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:34.430573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-195acb6a-8641-49d2-8aa9-cb67a4897ebe tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.226816 Aug 09 16:52:34.431520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 103/227] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:34 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:34.953131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:34.954753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:34.961427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:34.977455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:34.977455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:34.977455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:34.977455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:34.978958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:35.078129 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b435beca-185d-4360-85dd-9e2ec76ea2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:35.088272 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b435beca-185d-4360-85dd-9e2ec76ea2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:35.089626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b435beca-185d-4360-85dd-9e2ec76ea2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:35.090424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b435beca-185d-4360-85dd-9e2ec76ea2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:35.135146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:35.157505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:35.164796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:35.166614 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-173e100e-e57c-4603-8b58-627cc606d7ea tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.219905 Aug 09 16:52:35.169438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 125/228] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:34 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:35.248265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b435beca-185d-4360-85dd-9e2ec76ea2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Going to try to stop instance {{(pid=124901) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 16:52:35.454080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:35.454688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:35.466119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:35.466891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:35.467352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:35.468245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:35.469008 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:35.469586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:35.508521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b435beca-185d-4360-85dd-9e2ec76ea2db tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action" status: 202 len: 0 microversion: 2.1 time: 0.434996 Aug 09 16:52:35.511029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 104/229] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:52:35 2022] POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:52:35.520823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:35.521700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:35.535542 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:35.536302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:35.536835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:35.537864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:35.538575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:35.541048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:35.636877 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:35.645765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cf358f51-8497-4ddf-aedb-a193f4243e7e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.195284 Aug 09 16:52:35.646678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 126/230] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:35 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:35.713777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:35.726669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-df6ef473-b58b-432b-8d8f-e5ba8be1f275 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.210187 Aug 09 16:52:35.727506 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 105/231] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:35 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:36.193040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:36.193637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:36.201217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:36.201704 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:36.202126 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:36.202811 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:36.203285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:36.203705 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:36.370369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:36.383515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:36.385302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:36.388775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-06c8cb12-82ae-454c-848f-f51567c80338 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.199695 Aug 09 16:52:36.393793 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 127/232] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:36 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:36.667621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:36.668190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:36.674982 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:36.675514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:36.675956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:36.676664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:36.677321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:36.677749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:36.749507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:36.750293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:36.757257 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:36.758348 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:36.758803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:36.759608 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:36.760076 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:36.760509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:36.924071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:36.936257 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6728ef37-6073-40db-97ee-0e2232ca7771 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.191312 Aug 09 16:52:36.936849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 128/233] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:36 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:37.021183 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:37.029454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c16e15d0-501d-497b-8657-649a0464e634 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.366407 Aug 09 16:52:37.030113 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 106/234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:36 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:37.411029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:37.411695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:37.418213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:37.418694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:37.419156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:37.419861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:37.420306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:37.420726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:37.436702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:37.590695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:37.594061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:37.595816 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:37.597206 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-67d4ffdb-cc35-4570-a2e6-be27982fd72c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.190010 Aug 09 16:52:37.597905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 129/235] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:37 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:37.958310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:37.958882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:37.967488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:37.967976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:37.968402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:37.969150 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:37.969795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:37.970276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:38.050716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:38.052730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:38.058026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:38.058520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:38.058953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:38.059676 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:38.060134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:38.060817 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:38.110859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:38.119487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a438f760-ade3-4a4b-8abe-6407f5201b5f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.165240 Aug 09 16:52:38.120063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 107/236] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:37 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:38.194591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:38.202342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8b72b273-d1a6-4e12-bcd8-eaf98550c77d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.155596 Aug 09 16:52:38.202900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 130/237] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:38 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:38.623978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:38.624888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:38.626903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:38.631490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:38.632270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:38.632697 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:38.633623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:38.634259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:38.634682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:38.764800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:38.772873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:38.774380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:38.775533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4372dc8a-459f-4a23-af69-22ed782ab4dd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.155627 Aug 09 16:52:38.776094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 108/238] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:38 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:39.140716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:39.141338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:39.147833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:39.148825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:39.149260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:39.149958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:39.150415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:39.150843 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:39.222900 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:39.223556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:39.226996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:39.227772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=6 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:39.231839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:39.232333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:39.232779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:39.233482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:39.233970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:39.234402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:39.284928 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:39.294149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f4110c0b-ce35-4bbd-aca3-3d4a52ef6cb0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.157343 Aug 09 16:52:39.294915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 131/239] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:39 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:39.372089 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:39.380160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d850a498-6db0-499d-a258-cc400caa34ff tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.161243 Aug 09 16:52:39.380726 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 109/240] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:39 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:39.798491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:39.799031 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:39.804989 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:39.805468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:39.805902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:39.806598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:39.807047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:39.807491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:39.942401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:39.950293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:39.951842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:39.952965 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-22ec2234-4d83-440c-b30f-ad55c8e5810c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.158736 Aug 09 16:52:39.953566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 132/241] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:39 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:40.315405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:40.316057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:40.323563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:40.324038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:40.324499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:40.325179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:40.325629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:40.326048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:40.402581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:40.403304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:40.405770 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=12 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:40.410752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:40.411271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:40.411876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:40.412737 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:40.413196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:40.413812 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:40.468244 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:40.476511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1f4ef889-4dc3-4786-a618-511e54e2a857 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.164858 Aug 09 16:52:40.477090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 110/242] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:40 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:40.553242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:40.561828 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-05462c7a-8799-4386-ab27-a5e97a56632e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.163858 Aug 09 16:52:40.562418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 133/243] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:40 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:40.976556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:40.977554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:40.983953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:40.984443 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:40.984883 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:40.985576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:40.986041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:40.986465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:41.115927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:41.125389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:41.126888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:41.128049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-916c4eb3-1f3d-48e5-9f8c-f92c5dc30cca tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.155941 Aug 09 16:52:41.128628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 111/244] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:40 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:41.497760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:41.498405 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:41.504830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:41.505349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:41.505787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:41.506480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:41.506938 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:41.507407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:41.583725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:41.584378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:41.591487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:41.591976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:41.592436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:41.593168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:41.593623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:41.594052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:41.637929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:41.645937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-529b80b6-656d-41e4-ab6d-53011d971797 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.152117 Aug 09 16:52:41.646518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 134/245] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:41 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:41.726742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:41.734709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cd9d6b6c-3c93-477c-a876-def904c160f8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.154756 Aug 09 16:52:41.735302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 112/246] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:41 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:42.150119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:42.150735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:42.156702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:42.157189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:42.157631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:42.158322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:42.158786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:42.159244 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:42.287405 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:42.296393 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:42.297905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:42.299011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c1e41be8-be6a-4c2d-9196-0d4922f5aa14 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.153491 Aug 09 16:52:42.299602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 135/247] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:42 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:42.667988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:42.668600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:42.674947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:42.675474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:42.675904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:42.676585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:42.677038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:42.677460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:42.692434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:42.755687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:42.756312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:42.762983 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:42.763526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:42.764153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:42.764860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:42.765317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:42.766051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:42.815649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:42.824675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a2e8ea99-68dd-429a-9272-4aa047e9c71f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.161140 Aug 09 16:52:42.825922 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 113/248] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:42 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:42.906195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:42.915230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ed913117-338c-4143-9933-ccb46e26b40a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.162320 Aug 09 16:52:42.915230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 136/249] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:42 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:43.106942 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-412368d9-aae4-4952-b433-0aae45bc7911 req-be2c284d-67af-472b-8f1f-0dbc59bf56d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "name": "network-vif-plugged", "status": "completed", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:43.116879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-412368d9-aae4-4952-b433-0aae45bc7911 req-be2c284d-67af-472b-8f1f-0dbc59bf56d3 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.117537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-412368d9-aae4-4952-b433-0aae45bc7911 req-be2c284d-67af-472b-8f1f-0dbc59bf56d3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.118056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-412368d9-aae4-4952-b433-0aae45bc7911 req-be2c284d-67af-472b-8f1f-0dbc59bf56d3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:43.128847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-412368d9-aae4-4952-b433-0aae45bc7911 req-be2c284d-67af-472b-8f1f-0dbc59bf56d3 service nova] Creating event network-vif-plugged:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:52:43.134658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-412368d9-aae4-4952-b433-0aae45bc7911 req-be2c284d-67af-472b-8f1f-0dbc59bf56d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031708 Aug 09 16:52:43.135426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 114/250] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:52:43.322562 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:43.323358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:43.329369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.329864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.330309 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:43.331010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.331560 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.331990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:43.465595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:43.473717 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:43.475568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:43.477438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-757a3af2-7496-4da4-ad9b-7b05e7ffc9c7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.159705 Aug 09 16:52:43.478020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 137/251] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:43 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:43.849948 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:43.850651 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:43.856973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.857454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.857915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:43.858619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.859056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.859513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:43.935311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:43.936165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:43.942308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.942790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.943255 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:43.944003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:43.944458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:43.945387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:44.002664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:44.012698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fdcd6f86-75e3-475f-b765-96a855151385 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.168188 Aug 09 16:52:44.016294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 115/252] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:43 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:44.098117 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:44.106869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9251b43d-ea57-42b2-8dc0-03c44f3d6c4a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.175617 Aug 09 16:52:44.107486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 138/253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:43 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:44.500054 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:44.500669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:44.506596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:44.507078 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:44.507546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:44.508236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:44.508729 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:44.509178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:44.655091 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:44.663131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:44.667290 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:44.668426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3c9bb9f3-3abd-4543-b03a-ac69d0c09b8d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.172372 Aug 09 16:52:44.668989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 116/254] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:44 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:45.048536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:45.049925 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:45.059007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:45.059715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:45.060581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:45.061691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:45.062479 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:45.063090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:45.128142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:45.129517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:45.136323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:45.136891 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:45.137394 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:45.138161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:45.138834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:45.139290 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:45.222869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:45.237612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0c88eced-f73d-4098-9f22-1d4b65b56f68 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.192770 Aug 09 16:52:45.238224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 139/255] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:45 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:45.247438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a32ce64a-6cf9-45be-b766-12f1f4b17265 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: .version_select at 0x7fccc5096b80>, body: {"keypair": {"name": "tempest-keypair-1125425889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEbgk6QK7sv7AoPZEt+XhP6DXUM013chF+p4CClyA/Q9k6d6T2fCV5aYjtZWkrq2mSkbr1ddd46rg4JeHBgLl0jS7if8brg4vcTS4XP5uq8Fymb7GUeNR00IgOUrmFgtg=="}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:45.265320 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-a32ce64a-6cf9-45be-b766-12f1f4b17265 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:45.269521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-a32ce64a-6cf9-45be-b766-12f1f4b17265 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:45.305256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:45.313613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a6bc6abd-fe29-468f-83fd-0fc0601267c3 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.189277 Aug 09 16:52:45.314727 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 117/256] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:45 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:45.411342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a32ce64a-6cf9-45be-b766-12f1f4b17265 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172009 Aug 09 16:52:45.411964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 140/257] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:52:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:52:45.691656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:45.692615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:45.710348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:45.717956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:45.717956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:45.717956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:45.717956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:45.718677 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:45.893064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:45.902587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:45.904630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:45.905811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8bc720ca-5c42-417d-9087-16b7d41f9408 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1407 microversion: 2.20 time: 0.218064 Aug 09 16:52:45.906485 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 118/258] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:45 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:46.259680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:46.260813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:46.268751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:46.269422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:46.270074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:46.271017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:46.271654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:46.272265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:46.341326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:46.343499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:46.349776 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:46.350266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:46.350728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:46.352121 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:46.352583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:46.353021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:46.423263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:46.433356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9ba302ae-2205-4e92-a2e1-e54d41f408f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.178180 Aug 09 16:52:46.434221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 141/259] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:46 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:46.440253 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1629881993", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-983199229", "security_groups": [{"name": "tempest-secgroup-smoke-1542149782"}], "block_device_mapping_v2": [{"uuid": "7ff5108e-1360-4dec-8e0b-ec46a6a95a10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03ca7ab9-4a6d-42ee-86c4-e644a355c008"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:46.552071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:46.560492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a81fffc7-9802-4f42-bf10-77fcf943f430 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.227771 Aug 09 16:52:46.561337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 119/260] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:46 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:46.580505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] validate_networks() for [('03ca7ab9-4a6d-42ee-86c4-e644a355c008', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:52:46.935317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:46.936545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:46.943336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:46.944253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:46.945566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:46.946737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:46.947684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:46.948823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.154423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:47.168765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:47.170465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:47.172552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ae2b1ef2-aee4-4949-9686-7684cf1f390c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1599 microversion: 2.20 time: 0.240486 Aug 09 16:52:47.179732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 120/261] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:52:46 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1599 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:52:47.203864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:47.205383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:47.213358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.213988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.214498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.215440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.215965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.216458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.316395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2a79888b-f637-415b-8a0c-6f1a5335f0d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116317 Aug 09 16:52:47.317683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 121/262] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Aug 9 16:52:47 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:52:47.327484 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:52:47.328620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:52:47.328620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:52:47.328878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:52:47.329282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:52:47.338999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.339319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.339939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.340665 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.341277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.341866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.362149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:47.364835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for user 02b21bed2f2d4e58b3759349331d44c7 and project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:47.431234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:52:47.433355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ff5108e-1360-4dec-8e0b-ec46a6a95a10',volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:52:47.456073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:47.456690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:47.465081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.465632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.466148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.466905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.467395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.467817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.880617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:47.891418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-903ff4fd-ffb4-43bf-aad5-a645a2c6ee7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.439459 Aug 09 16:52:47.892007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 122/263] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:47 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:47.897733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:47.899470 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:47.905350 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.905937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.906442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.907251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:47.908141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:47.908766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:47.929740 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d8066400-808d-40b2-a6cd-837ae34ab854 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.494118 Aug 09 16:52:47.930413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 142/264] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:52:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:52:47.943546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-90181fe8-b846-4074-a56a-41f19cdfd351 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:47.944428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-90181fe8-b846-4074-a56a-41f19cdfd351 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:48.018024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-90181fe8-b846-4074-a56a-41f19cdfd351 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:48.033339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-90181fe8-b846-4074-a56a-41f19cdfd351 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1094 microversion: 2.1 time: 0.095313 Aug 09 16:52:48.034558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 143/265] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:47 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:48.270666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:48.279902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1912e426-b1c6-4f3e-a08e-b409de31d5ef tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.386636 Aug 09 16:52:48.280711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 123/266] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:47 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:48.922442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:48.924153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:48.934234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:48.935015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:48.936274 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:48.937419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:48.938159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:48.938945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:49.054115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-60189c6a-04e4-42fd-8120-dff865c9c3f3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:49.055358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-60189c6a-04e4-42fd-8120-dff865c9c3f3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:49.178949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-60189c6a-04e4-42fd-8120-dff865c9c3f3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:49.192093 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-60189c6a-04e4-42fd-8120-dff865c9c3f3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1094 microversion: 2.1 time: 0.141664 Aug 09 16:52:49.196336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:49.200747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 124/267] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:49 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1094 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:49.209519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d3d23209-f3df-471c-bec1-f3b9dfb80cd6 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.299096 Aug 09 16:52:49.210116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 144/268] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:48 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:49.212804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2054845361", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d512bb64-4fdf-40f1-b457-d57f69ae1831"}], "security_groups": [{"name": "tempest-securitygroup--885308628"}], "key_name": "tempest-keypair-1125425889", "user_data": "}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:49.302682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:49.303574 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:49.310286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:49.312607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:49.312607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:49.312607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:49.313252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:49.313827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:49.408594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] validate_networks() for [('d512bb64-4fdf-40f1-b457-d57f69ae1831', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:52:49.503096 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:49.516938 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c71e662b-05e2-41d2-b822-661548744338 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.218193 Aug 09 16:52:49.520987 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 145/269] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:49 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:49.525590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-5502ceef-5c5b-423a-a5a7-14be7dc35426 req-55148119-dcb1-49be-b354-308081b8fe53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:49.540235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-5502ceef-5c5b-423a-a5a7-14be7dc35426 req-55148119-dcb1-49be-b354-308081b8fe53 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:49.541272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-5502ceef-5c5b-423a-a5a7-14be7dc35426 req-55148119-dcb1-49be-b354-308081b8fe53 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:49.541703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-5502ceef-5c5b-423a-a5a7-14be7dc35426 req-55148119-dcb1-49be-b354-308081b8fe53 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:49.554448 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-5502ceef-5c5b-423a-a5a7-14be7dc35426 req-55148119-dcb1-49be-b354-308081b8fe53 service nova] Creating event network-changed:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:52:49.560427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-5502ceef-5c5b-423a-a5a7-14be7dc35426 req-55148119-dcb1-49be-b354-308081b8fe53 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040784 Aug 09 16:52:49.561586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 146/270] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:52:49.868219 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:52:49.868648 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:52:49.869326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:52:49.869927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:52:49.870420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:52:49.892597 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:49.894152 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:49.894850 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:49.897090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:49.900784 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:49.900784 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:49.947536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:49.957130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:50.022770 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:52:50.037621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:52:50.214619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3b1c5d0a-3bc9-48ba-b793-57f067f9f019 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.006020 Aug 09 16:52:50.215653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:50.216657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:50.219092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 125/271] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:52:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:52:50.223933 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:50.224678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:50.225329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:50.227129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:50.228420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:50.229094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:50.240643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2f13212d-20c3-42f6-bd81-45c5210f4135 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:50.242074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2f13212d-20c3-42f6-bd81-45c5210f4135 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:50.318667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:50.332343 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0b2f302c-39c8-4ab2-be0b-0bd3e3757d8e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1144 microversion: 2.1 time: 0.121814 Aug 09 16:52:50.333833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 147/272] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:50 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:50.342098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:50.343081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:50.355186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:50.355692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:50.356143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:50.357430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:50.357964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:50.358575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:50.368250 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2f13212d-20c3-42f6-bd81-45c5210f4135 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:50.379543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2f13212d-20c3-42f6-bd81-45c5210f4135 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1242 microversion: 2.1 time: 0.149942 Aug 09 16:52:50.380545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 126/273] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:50 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:50.545571 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:50.546432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:50.553775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:50.555307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:50.556046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:50.557036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:50.557648 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:50.558361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:50.579399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:50.588792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3b256d33-398a-4146-a0f9-8ccdeabe364a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.253355 Aug 09 16:52:50.591258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 148/274] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:50 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:50.725797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:50.734719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-467b5dc5-0591-4769-a5e4-7a077ccf8faa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.192906 Aug 09 16:52:50.736114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 127/275] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:50 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:51.159077 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1184062577", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "networks": [{"uuid": "e3964af6-46ca-431b-afc6-d66481e46704"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:51.213587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] validate_networks() for [('e3964af6-46ca-431b-afc6-d66481e46704', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:52:51.356620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:51.357311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:51.364505 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.365216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.365646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.366509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.367213 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.367811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.437722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:51.445370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b629ffd2-0665-48a3-ac71-b522c76899d9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1192 microversion: 2.1 time: 0.092833 Aug 09 16:52:51.446420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 128/276] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:51 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:51.450511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:51.451217 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:51.457507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.457964 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.458583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.459479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.459928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.460889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.524624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:51.532231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-23648aae-07c0-4c7f-a462-ee87ad8225d9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1246 microversion: 2.1 time: 0.085284 Aug 09 16:52:51.532804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 129/277] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:51 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:51.604298 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:52:51.604798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:52:51.605218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:52:51.605651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:52:51.606089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:52:51.611700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:51.612401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:51.615819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.616317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.616899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.617777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.618232 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.618658 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.618853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.619656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.620086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.620774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.621225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.621640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.638204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Getting quotas for project 7ea828531a5d468a9f15381d47e1594e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:52:51.642495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Getting quotas for user 88960dd0da2c4bb39e4fc1f773636231 and project 7ea828531a5d468a9f15381d47e1594e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:52:51.644880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:51.654904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:52:51.657311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:52:51.786784 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:51.795986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5e6218bf-f07b-4db1-8919-033e054e8b15 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.187224 Aug 09 16:52:51.795986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 130/278] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:51 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:51.799273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d56a8f02-94ef-4efe-b0ec-d974bcd799c8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643874 Aug 09 16:52:51.801504 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:51.802167 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:51.805926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 149/279] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:52:51.809361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.809929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.810956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.811331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-42c97159-dbec-46ff-86d2-edf4343bad6f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:51.811832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-42c97159-dbec-46ff-86d2-edf4343bad6f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:51.815375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:51.815756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:51.816234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:51.886184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-42c97159-dbec-46ff-86d2-edf4343bad6f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:51.894035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-42c97159-dbec-46ff-86d2-edf4343bad6f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1219 microversion: 2.1 time: 0.087096 Aug 09 16:52:51.894604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 150/280] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:51 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:52.033994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:52.045234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7dce10d5-592e-49a4-812f-e79cfab26d21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.247500 Aug 09 16:52:52.046466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 131/281] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:51 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:52.467444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:52.468061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:52.474175 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:52.474660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:52.475144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:52.475900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:52.476443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:52.476955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:52.480965 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:52.538083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:52.545747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fe73d97c-bb93-4b79-ae30-ef147a1c46a0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1200 microversion: 2.1 time: 0.083285 Aug 09 16:52:52.546566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 151/282] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:52 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:52.557464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:52.558658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:52.566165 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:52.566649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:52.567074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:52.567869 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:52.568315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:52.568732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:52.659332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:52.668166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4eeaff82-df4a-42cc-8aff-b56ae6bf2701 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1246 microversion: 2.1 time: 0.118086 Aug 09 16:52:52.668947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 132/283] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:52 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1246 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:52.819998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:52.821755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:52.830281 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:52.831445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:52.832387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:52.833507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:52.834262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:52.835204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:52.917396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f36ce17a-251c-4932-a568-c125ae2e618e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:52.918811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f36ce17a-251c-4932-a568-c125ae2e618e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:52.999225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:52.999692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f36ce17a-251c-4932-a568-c125ae2e618e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:53.006967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f36ce17a-251c-4932-a568-c125ae2e618e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1219 microversion: 2.1 time: 0.094853 Aug 09 16:52:53.008484 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 133/284] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:52 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:53.011956 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-771106df-14d4-4048-9ec5-2aeb49e8e1ee tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.197840 Aug 09 16:52:53.017991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 152/285] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:52 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:53.067636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:53.068364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:53.076947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.081247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.081247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.081247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.081247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.081715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.238890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:53.242454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:53.251308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c17b138d-8583-430d-968e-3cb2e40cf775 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1502 microversion: 2.1 time: 0.185317 Aug 09 16:52:53.251308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 134/286] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:53 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:53.269742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e38ee6f3-dbcd-44ee-b085-6f412628cbc1"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:53.272103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:53.284761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.285259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.285694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.286404 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.286858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.287501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.312620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] HTTP exception thrown: Cannot 'attach_volume' instance a4d48aed-6528-46cd-a11e-6899591a4a27 while it is in vm_state rescued Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Request method failure captured: Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/os-volume_attachments HTTP/1.1 Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 74 Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBhL9d8qboR3QkFRwU49x9sFiLeAQIxSrdali_ha4_JPziN37oRsK0P3Dbu5Z-fUJm39DaHNnsc1cckSTFHvgqIJssbnKvrPv1ymyhFgGBMRNYummTkBkuYAq97vQ3hHctrBf0WnT_zV9XnubQ6dznK9ZyF3FEMmFbE23nXq14kuyc Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:52:53.314823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b681b90f2f074e8c8cfb11939edc7f72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}] Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: c4529e57de654b36b53662be0148834c Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {"volumeAttachment": {"volumeId": "e38ee6f3-dbcd-44ee-b085-6f412628cbc1"}} Aug 09 16:52:53.316494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Cannot 'attach_volume' instance a4d48aed-6528-46cd-a11e-6899591a4a27 while it is in vm_state rescued Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'server_id': 'a4d48aed-6528-46cd-a11e-6899591a4a27', 'body': {'volumeAttachment': {'volumeId': 'e38ee6f3-dbcd-44ee-b085-6f412628cbc1'}}} Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:52:53.317512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a4d48aed-6528-46cd-a11e-6899591a4a27 while it is in vm_state rescued Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:52:53.319515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a4d48aed-6528-46cd-a11e-6899591a4a27 while it is in vm_state rescued Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Returning 409 to user: Cannot 'attach_volume' instance a4d48aed-6528-46cd-a11e-6899591a4a27 while it is in vm_state rescued {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-107e6f08-b52f-44d8-8542-a0f726500e3b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050629 Aug 09 16:52:53.321576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 153/287] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:52:53 2022] POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 16:52:53.328817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:53.329418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:53.336737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.337485 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.337837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.338580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.339036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.339497 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.567478 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:53.568016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:53.575842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.576321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.576750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.577444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.577898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.578314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.655014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:53.662576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1859a1bc-e78a-4f14-a0db-07520a57515d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1210 microversion: 2.1 time: 0.099151 Aug 09 16:52:53.663172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 154/288] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:53 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:53.677996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e79d7ced-a467-44af-b84b-29aa84fb3b5f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/action" status: 202 len: 0 microversion: 2.1 time: 0.353197 Aug 09 16:52:53.678639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 135/289] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:52:53 2022] POST /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:52:53.687811 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:53.694312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:53.694450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:53.694450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:53.698848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.699525 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.700004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.700704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.701158 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.701741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.706909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.710764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.711779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.713389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:53.713870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:53.714518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:53.839395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:53.849904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fc8765b6-87e8-4f6c-83bd-d018380424a8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1294 microversion: 2.1 time: 0.164335 Aug 09 16:52:53.852254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 136/290] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:53 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:53.916184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:53.924782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4b2bdf61-5b23-4238-9b1c-16b501d5862e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1510 microversion: 2.1 time: 0.241066 Aug 09 16:52:53.925364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 155/291] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:53 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1510 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:54.028768 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:54.031946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:54.036315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.037001 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.037641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.038524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.039816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.040502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.044397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:54.045033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:54.051895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.052389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.052828 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.053535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.054043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.055249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.229008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:54.234234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:54.238100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ce396654-15b1-4618-b45f-6bb86f0794d3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1223 microversion: 2.1 time: 0.213032 Aug 09 16:52:54.239189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 137/292] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:54 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1223 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:54.258948 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fdfb9668-9bcb-4a18-8a0b-9d361375ca77 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.220161 Aug 09 16:52:54.260993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 156/293] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:54 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:54.687129 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:54.688980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:54.697852 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.698591 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.699404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.700295 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.700744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.701163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.874356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:54.875386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:54.885279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.885871 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.886378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.887223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.887915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.888561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.964490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:54.973184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7b281f0e-190b-417d-a7fa-489b3d14897c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1300 microversion: 2.1 time: 0.102332 Aug 09 16:52:54.983153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 157/294] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:54 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:54.983153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:54.983153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:54.987128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.987714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.988160 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:54.988903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:54.989363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:54.989954 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:55.142670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:55.151406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-55bba0bf-e0bb-4e1e-91a2-852c207c6cc1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1510 microversion: 2.1 time: 0.176456 Aug 09 16:52:55.152000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 158/295] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:54 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:55.258438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:55.259094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:55.265578 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:55.266065 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:55.266502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:55.267224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:55.267709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:55.268133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:55.333055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:55.341334 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-685c10e8-f9cc-45d9-8958-9cf83a3423fd tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1279 microversion: 2.1 time: 0.086703 Aug 09 16:52:55.342266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 159/296] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:55 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:55.361083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:55.363726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:55.372801 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:55.374319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:55.375146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:55.376662 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:55.377750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:55.378379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:55.384809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:55.404739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0aee8e5f-360a-4276-bd27-05cb4b06f576 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1278 microversion: 2.1 time: 0.723209 Aug 09 16:52:55.405444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 138/297] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:54 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1278 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:55.542330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:55.551758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0e277a94-3008-4c74-b1f2-655d1c1728a9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.195284 Aug 09 16:52:55.552427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 160/298] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:55 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:55.995221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:55.995753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:56.002343 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.002833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.003310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.004017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.004475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.004904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.054045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-53ba36c7-0c7d-491d-8b16-f52afdb841c6 req-bf7b5221-aaed-4d14-ab7a-656165113713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6dea3ef-6792-4471-ba10-60009659c637", "tag": "7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:56.064861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-53ba36c7-0c7d-491d-8b16-f52afdb841c6 req-bf7b5221-aaed-4d14-ab7a-656165113713 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.065395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-53ba36c7-0c7d-491d-8b16-f52afdb841c6 req-bf7b5221-aaed-4d14-ab7a-656165113713 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.065828 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-53ba36c7-0c7d-491d-8b16-f52afdb841c6 req-bf7b5221-aaed-4d14-ab7a-656165113713 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.077512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-53ba36c7-0c7d-491d-8b16-f52afdb841c6 req-bf7b5221-aaed-4d14-ab7a-656165113713 service nova] Creating event network-changed:7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0 for instance d6dea3ef-6792-4471-ba10-60009659c637 on hv-cinder-85236 Aug 09 16:52:56.083080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-53ba36c7-0c7d-491d-8b16-f52afdb841c6 req-bf7b5221-aaed-4d14-ab7a-656165113713 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033128 Aug 09 16:52:56.083777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 161/299] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:52:56.137636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:56.146174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2ec805c6-a1f2-4168-be29-4dcea18f2aa1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1300 microversion: 2.1 time: 0.155028 Aug 09 16:52:56.146762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 139/300] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:55 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:56.173815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:56.174528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:56.181636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.183522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.183522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.183522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.184187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.184652 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.323562 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:56.331990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bf06af97-fcd0-4bba-a5c0-0172bd7f1e21 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1510 microversion: 2.1 time: 0.163406 Aug 09 16:52:56.332574 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 162/301] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:56 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:56.362430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:56.363202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:56.370926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.371823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.372724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.374036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.374853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.375564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.428696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:56.429328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:56.436794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.437296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.437732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.438441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.438900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.439434 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.468277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:56.478033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-22d90cdb-328c-49ab-9ba0-7d7744e99b49 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1277 microversion: 2.1 time: 0.119732 Aug 09 16:52:56.487251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 140/302] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:56 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:56.574616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:56.579647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:56.581519 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.582370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.582811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.584329 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:56.584724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:56.585146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:56.589148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:56.598930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c8b6bae3-151c-471e-b6cf-1e692331c8c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.173984 Aug 09 16:52:56.600709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 163/303] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:56 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:56.854413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:56.865271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-be865cfe-18f4-453d-9bcb-0a4bf49091df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.294415 Aug 09 16:52:56.865859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 141/304] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:56 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:57.169191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:57.169802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:57.176212 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.176714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.177143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.177827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.178275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.178692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.307065 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:57.314760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f8dc705c-433b-479e-8a3d-d5e5365d25a5 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.151118 Aug 09 16:52:57.315365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 164/305] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:57 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:57.354283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:57.354925 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:57.361358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.361846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.362288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.362979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.363462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.363887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.497520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:57.497941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:57.498564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:57.504633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.510135 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-86de3a97-90b9-4051-9985-3126edef8c3c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1510 microversion: 2.1 time: 0.155272 Aug 09 16:52:57.510277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.510277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.510466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 142/306] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:57 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:57.510550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.510550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.510550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.621178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:57.621798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:57.627771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.628260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.628706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.629398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.629857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.630317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.635284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:57.642635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-91f1942f-cbe3-452d-b4c8-0ede70de6a02 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.148610 Aug 09 16:52:57.646133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 165/307] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:57 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:57.887961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:57.888576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:57.894464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.896896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.896896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.896896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:57.897354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:57.897785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:57.945611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:57.955985 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2992f6bb-0de9-44e1-8432-be1dc510f365 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.338567 Aug 09 16:52:57.962030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 143/308] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:57 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:58.053634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:58.062787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-69088421-fb47-4f68-b267-2237fb42b47f tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1725 microversion: 2.1 time: 0.179086 Aug 09 16:52:58.069035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 166/309] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:57 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:58.336136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:58.336841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:58.343021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.343547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.343983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.344679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.345137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.345670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.527380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:58.527982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:58.535548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.536267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.536771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.537491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.537955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.538386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.681239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:58.689218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2c251ce0-4036-4b85-aa2c-1c0fed723f2b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1516 microversion: 2.1 time: 0.166080 Aug 09 16:52:58.689919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 167/310] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:58 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:58.703572 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:58.704501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:58.713215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.713779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.714307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.715044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.715609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.715972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.876327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:58.878723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:58.885557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b4e680a8-b597-4341-adb6-2826048e59f8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.194525 Aug 09 16:52:58.886331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 168/311] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:58 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:58.937046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:58.946790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5ea1e5df-2c6f-41c3-80f8-3723efb2565d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.614976 Aug 09 16:52:58.947416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 144/312] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:58 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:58.983695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:58.984389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:58.991510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.992300 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.992936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:58.993683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:58.994146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:58.994743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.084774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:59.086278 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:59.093509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.094304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.094953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.095959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.096623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.097522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.140069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:59.147697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4a7541c0-2cf9-45f5-9315-bac9b091adea tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.171408 Aug 09 16:52:59.154369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 169/313] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:58 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:52:59.456401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:52:59.468503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3b7e7fce-d719-4c8a-8a65-b3939dda64dc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1702 microversion: 2.1 time: 0.387495 Aug 09 16:52:59.476232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 145/314] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:59 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1702 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:52:59.491727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e717b1ce-f8db-45a4-b489-4cd135e3e4d2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:59.501818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e717b1ce-f8db-45a4-b489-4cd135e3e4d2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.502335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e717b1ce-f8db-45a4-b489-4cd135e3e4d2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.502774 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e717b1ce-f8db-45a4-b489-4cd135e3e4d2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.574908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e717b1ce-f8db-45a4-b489-4cd135e3e4d2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Going to try to start instance {{(pid=124900) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 16:52:59.698446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-be8affcd-4939-4394-b48d-9962d9dc7186 req-7b7b418a-cb08-4075-af61-0654dfd63db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c924ba86-e6ed-4312-9149-cd13ffd2af45", "tag": "d1b97e7d-8dd6-48df-af38-15a732a256dc"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:52:59.707993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-be8affcd-4939-4394-b48d-9962d9dc7186 req-7b7b418a-cb08-4075-af61-0654dfd63db1 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.708471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-be8affcd-4939-4394-b48d-9962d9dc7186 req-7b7b418a-cb08-4075-af61-0654dfd63db1 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.708898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-be8affcd-4939-4394-b48d-9962d9dc7186 req-7b7b418a-cb08-4075-af61-0654dfd63db1 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.722888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-be8affcd-4939-4394-b48d-9962d9dc7186 req-7b7b418a-cb08-4075-af61-0654dfd63db1 service nova] Creating event network-changed:d1b97e7d-8dd6-48df-af38-15a732a256dc for instance c924ba86-e6ed-4312-9149-cd13ffd2af45 on hv-cinder-85236 Aug 09 16:52:59.730200 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-be8affcd-4939-4394-b48d-9962d9dc7186 req-7b7b418a-cb08-4075-af61-0654dfd63db1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035947 Aug 09 16:52:59.733406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 146/315] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:52:59.758769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e717b1ce-f8db-45a4-b489-4cd135e3e4d2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action" status: 202 len: 0 microversion: 2.1 time: 0.272133 Aug 09 16:52:59.762171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 170/316] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:52:59 2022] POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:52:59.768234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:59.769168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:59.773780 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:52:59.777163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.777841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.778479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.779606 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.780307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.780932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.907468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:52:59.908175 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:52:59.918447 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.918926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.919396 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.920132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:52:59.920920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:52:59.921207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:52:59.932114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:00.073514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:00.083919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:00.089764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-58dfe83f-bd77-4628-b1c9-d391d02cba71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1711 microversion: 2.1 time: 0.324962 Aug 09 16:53:00.094504 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 147/317] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:59 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1711 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:00.094624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d657e3ae-b16b-425a-8f41-3b51e19990a9 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.190243 Aug 09 16:53:00.094624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 171/318] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:52:59 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:00.108715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:00.109336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:00.115418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:00.115972 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:00.116337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:00.117312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:00.117778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:00.118237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:00.169465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:00.170375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:00.176330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:00.176822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:00.177260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:00.177958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:00.178420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:00.178849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:00.249682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:00.258072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-53dea1cb-2db3-4422-bb8e-dc982e889834 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.165242 Aug 09 16:53:00.258833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 148/319] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:00 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:00.310854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:00.318566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7104efa6-dd99-477e-b3e6-d2b1a66a3c29 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.153068 Aug 09 16:53:00.319152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 172/320] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:00 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:00.487189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-058a855b-0967-4381-832e-47c28054b2ed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'create', calling method: .version_select at 0x7fccc4ee80d0>, body: {"keypair": {"name": "tempest-keypair-1487632429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn6p6I3lxq0anVKYFm3IYc7AFTDKxHlaxfL9hZpI5CnVpdjjSLQPqCeF+cpppyQ0IvN8hLGcNVw9wxLwsedDewPiuUWCj7ykYKESPhRh2CzMvq9CWxhKmXcSfhtZwBeZQ=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:00.503735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-058a855b-0967-4381-832e-47c28054b2ed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:53:00.508374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-058a855b-0967-4381-832e-47c28054b2ed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for user c4529e57de654b36b53662be0148834c and project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:53:00.600448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-058a855b-0967-4381-832e-47c28054b2ed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117339 Aug 09 16:53:00.601128 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 149/321] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:53:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:53:01.118635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:01.120316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:01.121930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:01.122625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:01.133624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.135868 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.136368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.136808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.137500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.138616 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.139256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.139989 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.140970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.141625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.142249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.146515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.317241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:01.329321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-54ef11d9-49e6-4364-9327-8e82deae4d7d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1711 microversion: 2.1 time: 0.215391 Aug 09 16:53:01.329321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 173/322] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:01 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1711 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:01.331746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:01.332515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:01.340443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.340926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.341355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.342046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.342496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.342908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.503338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:01.514113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c949ec3b-77f1-4a53-b366-372990d4d4a2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.186384 Aug 09 16:53:01.514738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 174/323] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:01 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:01.519722 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:01.520332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:01.526481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.526960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.527667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.528540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.529156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.529582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.596978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:01.610490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-20953163-c641-4a1b-9160-7e09feee5525 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.499865 Aug 09 16:53:01.611569 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 150/324] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:01 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:01.629225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=4 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:01.717734 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:01.724134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a667ebe8-f4e6-4a72-8552-9fc3b4e53cb9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.208097 Aug 09 16:53:01.724735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 175/325] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:01 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:01.752168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-d4e1842b-eb90-49de-a209-b850cb0069a3 req-654ece1d-f79b-4173-813e-b4c3cd250b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb82bef7-ce2f-4541-b695-2b1769932f23", "tag": "4a3e69ee-936d-4754-9dde-3c621ceacfcf"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:01.762177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-d4e1842b-eb90-49de-a209-b850cb0069a3 req-654ece1d-f79b-4173-813e-b4c3cd250b31 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:01.762657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-d4e1842b-eb90-49de-a209-b850cb0069a3 req-654ece1d-f79b-4173-813e-b4c3cd250b31 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:01.763098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-d4e1842b-eb90-49de-a209-b850cb0069a3 req-654ece1d-f79b-4173-813e-b4c3cd250b31 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:01.774712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-d4e1842b-eb90-49de-a209-b850cb0069a3 req-654ece1d-f79b-4173-813e-b4c3cd250b31 service nova] Creating event network-changed:4a3e69ee-936d-4754-9dde-3c621ceacfcf for instance cb82bef7-ce2f-4541-b695-2b1769932f23 on hv-cinder-85236 Aug 09 16:53:01.779492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-d4e1842b-eb90-49de-a209-b850cb0069a3 req-654ece1d-f79b-4173-813e-b4c3cd250b31 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Aug 09 16:53:01.780081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 151/326] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:02.348075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:02.348672 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:02.350827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=20 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:02.356860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.357341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.357777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.359530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.359530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.359530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.534951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:02.535741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:02.542636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.543279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.543788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.544565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.545123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.545622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.600266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:02.610085 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f841e3dc-b889-4779-87d2-5d323613890c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1711 microversion: 2.1 time: 0.265765 Aug 09 16:53:02.615084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 176/327] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:02 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1711 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:02.633786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:02.634513 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:02.640709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.641260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.641697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.644127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.644127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.644127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.846823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:02.849412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:02.856681 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-319ca2a3-4e8d-4afa-b76e-eff698de208a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.326417 Aug 09 16:53:02.868561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 152/328] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:02 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:02.868561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:02.868561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:02.870376 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.870910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.871614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.872924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:02.873430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:02.873931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:02.883218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:02.894614 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-79dd6b79-48fa-4a49-94b3-4f76b8a3a877 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.264914 Aug 09 16:53:02.912342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 177/329] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:02 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:03.082234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:03.092145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-24656fee-8aad-4d2d-93d8-cd18e37306ed tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.233352 Aug 09 16:53:03.095691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 153/330] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:02 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:03.368745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-280497029", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7c6cdf7-0095-4da2-9004-cdee3c973d7e"}], "security_groups": [{"name": "tempest-securitygroup--1254362327"}], "key_name": "tempest-keypair-1487632429", "user_data": "}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:03.474301 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] validate_networks() for [('e7c6cdf7-0095-4da2-9004-cdee3c973d7e', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:53:03.631291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:03.631955 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:03.639412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:03.639903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:03.640345 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:03.641724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:03.642193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:03.642631 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:03.782111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:03.790927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d8d5947e-37ba-42d1-aacb-1c79ae79655c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1711 microversion: 2.1 time: 0.163611 Aug 09 16:53:03.791553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 154/331] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:03 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:03.849508 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:53:03.856376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:53:03.856376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:53:03.856376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:53:03.856376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:53:03.860349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:03.860831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:03.861267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:03.862026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:03.862467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:03.862893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:03.878130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:03.878752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:03.880230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:53:03.884898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Getting quotas for user c4529e57de654b36b53662be0148834c and project b681b90f2f074e8c8cfb11939edc7f72. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:53:03.885307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:03.885794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:03.886233 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:03.886933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:03.887449 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:03.887874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:03.897672 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:53:03.900595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:53:04.018153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:04.025755 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bbf6100e-190d-4c31-9d63-cad2ac23eda2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.151434 Aug 09 16:53:04.026416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 155/332] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:03 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:04.031089 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:04.031717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:04.037279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:04.037765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:04.038196 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:04.039628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:04.040084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:04.040506 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:04.064314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e7f482e1-0833-442d-9d1f-fdc1546fab23 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.700431 Aug 09 16:53:04.065139 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 178/333] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:53:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 16:53:04.075803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8ca9003e-b4ab-42c7-98f5-ec8707f2fc58 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:04.076425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8ca9003e-b4ab-42c7-98f5-ec8707f2fc58 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:04.142600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8ca9003e-b4ab-42c7-98f5-ec8707f2fc58 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:04.152019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8ca9003e-b4ab-42c7-98f5-ec8707f2fc58 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1245 microversion: 2.1 time: 0.079912 Aug 09 16:53:04.152930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 179/334] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:04 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:04.157476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:04.158365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:04.165712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:04.166352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:04.166796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:04.167516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:04.167969 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:04.168392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:04.196761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:04.204530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-419195dc-2b79-4259-8a2d-4d744c1cdb51 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.177050 Aug 09 16:53:04.205107 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 156/335] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:04 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:04.306909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:04.314830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9625741d-3085-45a7-a370-5966f61a1049 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.161054 Aug 09 16:53:04.315433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 180/336] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:04 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:04.812831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:04.813588 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:04.820751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:04.821355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:04.821867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:04.822574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:04.823030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:04.824558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:04.962346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:04.970751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c38de01c-bca5-4a74-b042-04b1750c638e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1711 microversion: 2.1 time: 0.161859 Aug 09 16:53:04.977192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 157/337] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:04 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1711 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:05.046887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:05.047730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:05.054709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.055238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.055680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.056386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.056913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.057344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.173077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:05.173697 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:05.179573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.183215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.183215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.183215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.183215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.183603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.212407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:05.220502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-54748c4e-492e-43f8-83fb-0122b2628586 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.177410 Aug 09 16:53:05.221171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 181/338] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:05 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:05.240280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:05.240900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:05.245500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:05.247431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.247914 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.248345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.249698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.249698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.250115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.254198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f161225b-07f5-492e-871d-f8f1ba984697 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1249 microversion: 2.1 time: 0.084847 Aug 09 16:53:05.255179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 158/339] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:05 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:05.336942 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:05.337563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:05.343509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.343995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.344430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.345123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:05.345575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:05.345999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:05.393757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:05.402078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-18d09ba0-9db9-4798-a2d3-43cdf3cedc22 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.166393 Aug 09 16:53:05.402650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 182/340] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:05 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:05.479004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:05.486374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7a4a6ba3-5d00-49ce-a940-a48b8a13c7e3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.153975 Aug 09 16:53:05.486932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 159/341] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:05 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:05.993927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:05.999913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:06.000366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.000855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.001283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.001975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.002428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.002844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.136555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:06.144562 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-445175fd-b25f-43a3-ac5d-fb2eca9097af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1715 microversion: 2.1 time: 0.155317 Aug 09 16:53:06.145107 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 183/342] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:05 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:06.241219 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:06.241937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:06.248401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.248883 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.249320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.250011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.250469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.250896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.285131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:06.285759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:06.292053 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.292542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.292979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.293683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.294135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.294556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.356319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:06.363643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6537316f-bbc7-470d-8071-e3061bff832c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1249 microversion: 2.1 time: 0.082323 Aug 09 16:53:06.364237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 184/343] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:06 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:06.386833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:06.394334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-be43d761-5147-4b78-9fd1-2a118e1e7f46 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.157044 Aug 09 16:53:06.396024 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 160/344] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:06 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:06.422771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:06.423413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:06.429999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.430768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.431245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.431934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.432385 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.432803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.506938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:06.507684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:06.514544 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.515036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.515504 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.516203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:06.516662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:06.517087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:06.562674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:06.570369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2646dccd-4c35-4f74-a522-da5908413b9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.151467 Aug 09 16:53:06.570961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 185/345] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:06 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:06.651124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:06.658582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-06315982-67cc-4d0e-ba24-000ae8f3bc08 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.155513 Aug 09 16:53:06.659165 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 161/346] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:06 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:07.385290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:07.386040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:07.388379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:07.393562 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.394046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.394476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.395191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.395643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.396093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.402180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:07.417079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:07.417702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:07.425494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.429458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.429458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.429458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.429458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.429926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.468772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:07.477131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f943cadb-fd46-4985-aba5-c59fa98d63b6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1241 microversion: 2.1 time: 0.095751 Aug 09 16:53:07.483153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 186/347] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:07 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:07.483153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-e365f237-efe2-4a17-b157-da34f75193a2 req-cad177a7-4efc-4b63-a222-326c0d6b9ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb82bef7-ce2f-4541-b695-2b1769932f23", "name": "network-vif-plugged", "status": "completed", "tag": "4a3e69ee-936d-4754-9dde-3c621ceacfcf"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:07.493269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-e365f237-efe2-4a17-b157-da34f75193a2 req-cad177a7-4efc-4b63-a222-326c0d6b9ccb service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.499848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-e365f237-efe2-4a17-b157-da34f75193a2 req-cad177a7-4efc-4b63-a222-326c0d6b9ccb service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.499848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-e365f237-efe2-4a17-b157-da34f75193a2 req-cad177a7-4efc-4b63-a222-326c0d6b9ccb service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.508312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-e365f237-efe2-4a17-b157-da34f75193a2 req-cad177a7-4efc-4b63-a222-326c0d6b9ccb service nova] Creating event network-vif-plugged:4a3e69ee-936d-4754-9dde-3c621ceacfcf for instance cb82bef7-ce2f-4541-b695-2b1769932f23 on hv-cinder-85236 Aug 09 16:53:07.513600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-e365f237-efe2-4a17-b157-da34f75193a2 req-cad177a7-4efc-4b63-a222-326c0d6b9ccb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 Aug 09 16:53:07.514411 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 187/348] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:07.587955 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:07.591683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:07.592413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:07.595633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1a4b9810-f495-438c-b1e7-cb74ae88f1fb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.183786 Aug 09 16:53:07.596399 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 162/349] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:07 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:07.598617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.599134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.599597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.600294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.600753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.601326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.680137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:07.680670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:07.687661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.688040 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.688353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.689064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:07.689519 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:07.689943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:07.836924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:07.844978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b6301ed0-5288-4b24-855b-5bea56a3a394 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.168785 Aug 09 16:53:07.845574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 163/350] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:07 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:07.939322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:07.946686 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0e4d14e1-8fd0-4e7b-b946-4a956c3409c2 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.359699 Aug 09 16:53:07.947284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 188/351] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:07 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:08.498313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:08.499131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:08.505636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.506118 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.506552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.507271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.507725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.508738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.572833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:08.580208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8ea1457c-d511-4e91-84c4-df0bc83e7cc0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1305 microversion: 2.1 time: 0.085840 Aug 09 16:53:08.580769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 164/352] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:08 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:08.616885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:08.618042 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:08.624930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.625449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.625893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.626587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.627047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.627501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.756153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:08.764190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4a4dec71-52a2-4b43-b28f-d26a558b260b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.151478 Aug 09 16:53:08.764753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 189/353] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:08 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:08.866175 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:08.866713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:08.873380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.873862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.874316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.874993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.875474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.875895 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.966690 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:08.967448 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:08.973278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.973762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.974313 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:08.975521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:08.975991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:08.976469 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:09.033582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:09.042108 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b33f7011-db9b-4e91-ba85-ae61c59fd9c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.179877 Aug 09 16:53:09.042685 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 165/354] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:08 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:09.110561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:09.118675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-462cca11-d3ea-45f6-8423-8f947a6cca4e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.155768 Aug 09 16:53:09.119282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 190/355] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:08 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:09.600949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:09.601545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:09.609050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:09.609777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:09.610215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:09.610918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:09.611397 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:09.612005 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:09.691540 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:09.702003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a696ae8a-b79a-4640-89b7-5dcd22316c9e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1305 microversion: 2.1 time: 0.104590 Aug 09 16:53:09.702931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 166/356] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:09 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:09.786092 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:09.787078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:09.794337 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:09.794951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:09.795518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:09.796409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:09.797164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:09.797834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:09.936368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:09.944673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a3dbc66d-6398-49e2-bf51-2d187d69c764 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1367 microversion: 2.1 time: 0.163251 Aug 09 16:53:09.945271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 191/357] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:09 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:10.063981 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:10.064593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:10.070395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.070871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.072592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.073310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.073875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.074301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.139770 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:10.140455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:10.147172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.147172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.147590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.148305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.148760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.149188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.307870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:10.314416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:10.316272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c6bf8992-e325-4a69-9443-b778ac0d7e54 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.180557 Aug 09 16:53:10.316860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 192/358] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:10 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:10.323259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ad16c4c5-d919-4d84-8c09-f3d9eb5de225 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.264492 Aug 09 16:53:10.323981 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 167/359] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:10 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:10.725045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:10.726056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:10.734156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.735033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.735568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.736532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.737074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.737596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.889578 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:10.898696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d1ef4c02-61f5-464a-9c75-453302620307 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.178142 Aug 09 16:53:10.900389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 193/360] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:10 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:10.969901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:10.971296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:10.974869 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=16 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:10.980489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.981274 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.981943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:10.982918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:10.983692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:10.984316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.182396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:11.190321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3786c039-02ac-49d3-b175-bc5bd53c34f3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1556 microversion: 2.1 time: 0.225183 Aug 09 16:53:11.190890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 168/361] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:10 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:11.210746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:11.211262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:11.217343 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.217887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.222712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.222712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.222712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.222712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.305299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-43fe08f2-4cfc-49c1-9fec-6627545a7e85 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098442 Aug 09 16:53:11.306897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 194/362] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:53:11 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:11.345008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:11.348433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:11.349091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:11.349486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:11.358491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.359304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.359845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.360151 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.360665 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.361106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.361379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.361810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.362037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.362269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.362644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.363264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.392481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:11.548879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:11.556898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d387d67d-85ad-4158-bc09-878fc9addb38 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.222811 Aug 09 16:53:11.557472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 169/363] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:11 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:11.606264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-526835f2-796c-4c0f-8407-614626ec92fd req-745856a6-4a29-41b1-860d-2573a0b79eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f72561-f391-43d4-8264-28016993a6a5", "tag": "9f544325-972f-4e60-9365-73a4114a5bfb"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:11.622618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:11.627510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-526835f2-796c-4c0f-8407-614626ec92fd req-745856a6-4a29-41b1-860d-2573a0b79eaa service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.632590 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-526835f2-796c-4c0f-8407-614626ec92fd req-745856a6-4a29-41b1-860d-2573a0b79eaa service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.632590 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-526835f2-796c-4c0f-8407-614626ec92fd req-745856a6-4a29-41b1-860d-2573a0b79eaa service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.636688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b2eb3993-2b04-42ab-a737-d43c991753bb tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.294533 Aug 09 16:53:11.650398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 195/364] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:11 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:53:11.650607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-526835f2-796c-4c0f-8407-614626ec92fd req-745856a6-4a29-41b1-860d-2573a0b79eaa service nova] Creating event network-changed:9f544325-972f-4e60-9365-73a4114a5bfb for instance 53f72561-f391-43d4-8264-28016993a6a5 on hv-cinder-85236 Aug 09 16:53:11.653683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-526835f2-796c-4c0f-8407-614626ec92fd req-745856a6-4a29-41b1-860d-2573a0b79eaa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055490 Aug 09 16:53:11.654458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 170/365] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:11.924251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:11.924874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:11.934110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.934607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.935047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:11.937255 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:11.937767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:11.938370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:12.195280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:12.203009 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-51343e10-6f31-44f3-b536-8c1d21353ae1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.282759 Aug 09 16:53:12.203814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 196/366] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:11 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:12.512060 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-7b64bd41-6014-4fc5-80c7-fa8b3f26d9f5 req-151adb68-4a14-48d7-9848-023202b8f3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb82bef7-ce2f-4541-b695-2b1769932f23", "tag": "4a3e69ee-936d-4754-9dde-3c621ceacfcf"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:12.522494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-7b64bd41-6014-4fc5-80c7-fa8b3f26d9f5 req-151adb68-4a14-48d7-9848-023202b8f3af service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:12.523069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-7b64bd41-6014-4fc5-80c7-fa8b3f26d9f5 req-151adb68-4a14-48d7-9848-023202b8f3af service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:12.523694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-7b64bd41-6014-4fc5-80c7-fa8b3f26d9f5 req-151adb68-4a14-48d7-9848-023202b8f3af service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:12.537573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-7b64bd41-6014-4fc5-80c7-fa8b3f26d9f5 req-151adb68-4a14-48d7-9848-023202b8f3af service nova] Creating event network-changed:4a3e69ee-936d-4754-9dde-3c621ceacfcf for instance cb82bef7-ce2f-4541-b695-2b1769932f23 on hv-cinder-85236 Aug 09 16:53:12.544595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-7b64bd41-6014-4fc5-80c7-fa8b3f26d9f5 req-151adb68-4a14-48d7-9848-023202b8f3af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038166 Aug 09 16:53:12.545523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 171/367] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:12.578896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:12.580999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:12.589910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:12.590573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:12.591132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:12.591970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:12.592538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:12.593033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:12.660099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:12.660935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:12.669283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:12.669896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:12.670442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:12.671478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:12.672109 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:12.672702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:12.750912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:12.764246 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bdd0e7d6-8ad4-4471-ad4a-20f42308c79a tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.190783 Aug 09 16:53:12.765088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 197/368] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:12 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:12.997045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:13.005354 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-af418888-502e-493a-934e-162e3bf40072 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.351041 Aug 09 16:53:13.006160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 172/369] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:12 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:13.224957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:13.225712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:13.232563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:13.232977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:13.233625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:13.234333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:13.234787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:13.235289 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:13.372376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:13.380010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-27eb7b68-54b6-43ac-ba66-f3ecba9ee362 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.160024 Aug 09 16:53:13.387337 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 198/370] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:13 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:13.607136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-96a6a2b3-c7f5-4036-908e-854bca2beb15 req-ffbf229b-ddd0-47aa-954e-a8680c215925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c924ba86-e6ed-4312-9149-cd13ffd2af45", "name": "network-vif-plugged", "status": "completed", "tag": "d1b97e7d-8dd6-48df-af38-15a732a256dc"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:13.616592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-96a6a2b3-c7f5-4036-908e-854bca2beb15 req-ffbf229b-ddd0-47aa-954e-a8680c215925 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:13.617315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-96a6a2b3-c7f5-4036-908e-854bca2beb15 req-ffbf229b-ddd0-47aa-954e-a8680c215925 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:13.617753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-96a6a2b3-c7f5-4036-908e-854bca2beb15 req-ffbf229b-ddd0-47aa-954e-a8680c215925 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:13.630606 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-96a6a2b3-c7f5-4036-908e-854bca2beb15 req-ffbf229b-ddd0-47aa-954e-a8680c215925 service nova] Creating event network-vif-plugged:d1b97e7d-8dd6-48df-af38-15a732a256dc for instance c924ba86-e6ed-4312-9149-cd13ffd2af45 on hv-cinder-85236 Aug 09 16:53:13.635644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-96a6a2b3-c7f5-4036-908e-854bca2beb15 req-ffbf229b-ddd0-47aa-954e-a8680c215925 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Aug 09 16:53:13.636258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 173/371] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:13.786012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:13.786752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:13.794121 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:13.794696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:13.795221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:13.796002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:13.796537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:13.797051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:13.869958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:13.935286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:13.943252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4f8fb64a-e5ed-45a9-9001-cc490ae32ada tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.161341 Aug 09 16:53:13.943821 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 199/372] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:13 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:14.027043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:14.027991 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:14.034181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:14.034662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:14.035088 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:14.035795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:14.036245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:14.036664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:14.175307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:14.184091 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-25bfb0d2-ac9b-44b2-945c-b2c74c7b3e11 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.161409 Aug 09 16:53:14.187902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 174/373] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:14 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:14.401274 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:14.402080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:14.403959 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=8 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:14.409237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:14.409716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:14.411090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:14.411090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:14.411311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:14.411741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:14.546500 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:14.554151 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b95e8ab2-9d77-4eae-b528-ab156db562dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.157010 Aug 09 16:53:14.554734 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 200/374] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:14 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:14.964885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:14.965510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:14.972172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:14.972658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:14.973178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:14.973877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:14.974334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:14.974759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:15.170823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:15.178362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fa5c7913-2c5b-4d15-b9aa-ca80de728bbc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.218161 Aug 09 16:53:15.178926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 175/375] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:14 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:15.205555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:15.206171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:15.212819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:15.213360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:15.213864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:15.214559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:15.215018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:15.215470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:15.342721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:15.350127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-683a1404-e4ba-4ed5-9708-c4975e61f492 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.148494 Aug 09 16:53:15.350685 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 201/376] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:15 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:15.574709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:15.575438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:15.581666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:15.582146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:15.582575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:15.583298 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:15.583743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:15.589034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:15.650641 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-4d740247-b309-438d-b03e-ddc230ad97b1 req-dbcefd4a-3de3-4834-8a16-c6c4818dfb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6dea3ef-6792-4471-ba10-60009659c637", "name": "network-vif-plugged", "status": "completed", "tag": "7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:15.660921 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-4d740247-b309-438d-b03e-ddc230ad97b1 req-dbcefd4a-3de3-4834-8a16-c6c4818dfb75 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:15.661402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-4d740247-b309-438d-b03e-ddc230ad97b1 req-dbcefd4a-3de3-4834-8a16-c6c4818dfb75 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:15.661834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-4d740247-b309-438d-b03e-ddc230ad97b1 req-dbcefd4a-3de3-4834-8a16-c6c4818dfb75 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:15.673594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-4d740247-b309-438d-b03e-ddc230ad97b1 req-dbcefd4a-3de3-4834-8a16-c6c4818dfb75 service nova] Creating event network-vif-plugged:7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0 for instance d6dea3ef-6792-4471-ba10-60009659c637 on hv-cinder-85236 Aug 09 16:53:15.679501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-4d740247-b309-438d-b03e-ddc230ad97b1 req-dbcefd4a-3de3-4834-8a16-c6c4818dfb75 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Aug 09 16:53:15.680409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 202/377] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:15.721436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:15.729151 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bd415a56-888b-41b7-b3ed-93c38d954e7a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.158476 Aug 09 16:53:15.729719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 176/378] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:15 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:16.201215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:16.201913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:16.208023 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:16.208498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:16.208927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:16.209605 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:16.210055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:16.210474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:16.340084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:16.347469 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4f0864a9-29ac-4a11-8c7d-eb8b7695f3ae tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.151506 Aug 09 16:53:16.348042 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 203/379] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:16 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:16.370070 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:16.370687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:16.377209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:16.377727 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:16.378166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:16.378849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:16.379348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:16.379775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:16.510987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:16.518880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ae0f06a5-8023-422e-9fac-5fc8555bd2c8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.153107 Aug 09 16:53:16.519489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 177/380] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:16 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:16.750093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:16.750699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:16.757153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:16.757641 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:16.758080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:16.758777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:16.759551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:16.759911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:16.776444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:16.892703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:16.900685 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-98b9788b-d646-4dce-8f23-c87cbca1dcea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.154797 Aug 09 16:53:16.901263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 204/381] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:16 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:17.369163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:17.369790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:17.376110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:17.376702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:17.377005 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:17.377689 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:17.378143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:17.378567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:17.506961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:17.514791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9c7ec3a1-ccae-455c-b112-0ef4adbe359e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1319 microversion: 2.1 time: 0.150191 Aug 09 16:53:17.515397 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 178/382] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:17 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:17.539836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:17.541078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:17.547221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:17.547709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:17.548200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:17.548897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:17.549355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:17.549782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:17.685788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:17.693556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-712a4cd0-f576-4d54-88d6-7c90ee169178 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.157969 Aug 09 16:53:17.694363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 205/383] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:17 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:17.920842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:17.921373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:17.927404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:17.927890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:17.928327 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:17.929644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:17.929644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:17.929910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:18.061563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:18.069130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-463630a1-89b8-4254-b579-2787bbdd83c8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.152248 Aug 09 16:53:18.069709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 179/384] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:17 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:18.537177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:18.537706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:18.544510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:18.544986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:18.545413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:18.546093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:18.546541 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:18.546958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:18.682433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:18.690117 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-00c7b6c5-2fdf-4c56-87e3-6836d1594d34 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1508 microversion: 2.1 time: 0.156951 Aug 09 16:53:18.690679 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 206/385] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:18 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:18.714182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:18.714883 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:18.721411 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:18.721893 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:18.722508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:18.724901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:18.724901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:18.724901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:18.863486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:18.871564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ae7c7b41-1866-4ab8-a6ff-8c3709ddc550 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1266 microversion: 2.1 time: 0.161153 Aug 09 16:53:18.872172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 180/386] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:18 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:19.090741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:19.091315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:19.097284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:19.097827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:19.098264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:19.098962 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:19.099451 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:19.099883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:19.231412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:19.239196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bb42c694-0745-4baf-bb47-897eea13e09f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.153275 Aug 09 16:53:19.239763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 207/387] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:19 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:19.893322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:19.893931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:19.901195 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:19.901618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:19.902053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:19.902745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:19.903226 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:19.903654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:20.038400 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:20.047315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-65f1c0d5-31e7-41d2-9e5e-ba6d247c8e1b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1452 microversion: 2.1 time: 0.157989 Aug 09 16:53:20.047901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 181/388] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:19 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:20.068486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:20.069135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:20.076109 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:20.076686 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:20.077129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:20.077830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:20.078289 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:20.078718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:20.215360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:20.222849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-63328f73-cbbd-48be-9605-62005a9bb090 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1452 microversion: 2.1 time: 0.158519 Aug 09 16:53:20.223449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 208/389] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:20 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:20.261437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:20.262054 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:20.268416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:20.269073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:20.269735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:20.270518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:20.271062 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:20.271596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:20.444896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:20.457197 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-59a350e3-6ee6-4f7e-8660-30dd7f39560a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.198594 Aug 09 16:53:20.457405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 182/390] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:20 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:20.972964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-e1c5006c-9042-4573-8784-28eafb0e4e1a req-87f4ccc3-9e8b-4c6c-b445-0916cb0db390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f72561-f391-43d4-8264-28016993a6a5", "name": "network-vif-plugged", "status": "completed", "tag": "9f544325-972f-4e60-9365-73a4114a5bfb"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:20.984379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-e1c5006c-9042-4573-8784-28eafb0e4e1a req-87f4ccc3-9e8b-4c6c-b445-0916cb0db390 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:20.984934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-e1c5006c-9042-4573-8784-28eafb0e4e1a req-87f4ccc3-9e8b-4c6c-b445-0916cb0db390 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:20.985463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-e1c5006c-9042-4573-8784-28eafb0e4e1a req-87f4ccc3-9e8b-4c6c-b445-0916cb0db390 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:20.997594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-e1c5006c-9042-4573-8784-28eafb0e4e1a req-87f4ccc3-9e8b-4c6c-b445-0916cb0db390 service nova] Creating event network-vif-plugged:9f544325-972f-4e60-9365-73a4114a5bfb for instance 53f72561-f391-43d4-8264-28016993a6a5 on hv-cinder-85236 Aug 09 16:53:21.002390 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-e1c5006c-9042-4573-8784-28eafb0e4e1a req-87f4ccc3-9e8b-4c6c-b445-0916cb0db390 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033431 Aug 09 16:53:21.003001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 209/391] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:53:21.476227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:21.477095 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:21.485398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:21.485880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:21.486314 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:21.487000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:21.487478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:21.488035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:21.683618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:21.692433 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5a898fb9-2e0b-4426-a420-d1d76c383a55 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.220082 Aug 09 16:53:21.693177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 183/392] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:21 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:22.617339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-a4795be2-56e4-46ec-84f8-04a962c3fea4 req-7223906e-9ecd-4b07-af18-5d805751c31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6dea3ef-6792-4471-ba10-60009659c637", "tag": "7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:22.626018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-a4795be2-56e4-46ec-84f8-04a962c3fea4 req-7223906e-9ecd-4b07-af18-5d805751c31f service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:22.626999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-a4795be2-56e4-46ec-84f8-04a962c3fea4 req-7223906e-9ecd-4b07-af18-5d805751c31f service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:22.627460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-a4795be2-56e4-46ec-84f8-04a962c3fea4 req-7223906e-9ecd-4b07-af18-5d805751c31f service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:22.644468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-a4795be2-56e4-46ec-84f8-04a962c3fea4 req-7223906e-9ecd-4b07-af18-5d805751c31f service nova] Creating event network-changed:7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0 for instance d6dea3ef-6792-4471-ba10-60009659c637 on hv-cinder-85236 Aug 09 16:53:22.649282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-a4795be2-56e4-46ec-84f8-04a962c3fea4 req-7223906e-9ecd-4b07-af18-5d805751c31f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041701 Aug 09 16:53:22.649956 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 210/393] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:22.714256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:22.714857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:22.721510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:22.721998 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:22.722438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:22.723158 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:22.723613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:22.724037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:22.861481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:22.870547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f367309e-99ab-4974-8b49-33d705dcdeed tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.160304 Aug 09 16:53:22.871162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 184/394] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:22 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:23.892880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:23.893635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:23.900162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:23.900743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:23.901190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:23.901891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:23.902351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:23.902786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:24.038233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:24.046861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a6779d13-f096-496e-8cdd-fbc0c1d37cd8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1371 microversion: 2.1 time: 0.158868 Aug 09 16:53:24.047594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 211/395] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:23 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:25.069124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:25.069674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:25.076344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:25.076824 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:25.077258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:25.077950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:25.078405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:25.078877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:25.210131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:53:25.218793 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f256f8f1-18d2-4fb0-962d-9f0ac705f288 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1564 microversion: 2.1 time: 0.153576 Aug 09 16:53:25.219440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 185/396] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:53:25 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:53:25.239361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:25.239866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:25.246331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:25.246811 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:25.247275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:25.247992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:25.248450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:25.248885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:25.334606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cd660af1-35a7-45e6-ad7b-2811872b4f65 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099081 Aug 09 16:53:25.335278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 212/397] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:53:25 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:26.387772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-a297af06-6fd5-4aa7-a8f1-72d54fc63584 req-13e3d2e0-c23d-413c-bff2-0aec1d21f20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f72561-f391-43d4-8264-28016993a6a5", "tag": "9f544325-972f-4e60-9365-73a4114a5bfb"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:26.398208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a297af06-6fd5-4aa7-a8f1-72d54fc63584 req-13e3d2e0-c23d-413c-bff2-0aec1d21f20e service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:26.398708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a297af06-6fd5-4aa7-a8f1-72d54fc63584 req-13e3d2e0-c23d-413c-bff2-0aec1d21f20e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:26.399157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a297af06-6fd5-4aa7-a8f1-72d54fc63584 req-13e3d2e0-c23d-413c-bff2-0aec1d21f20e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:26.410807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-a297af06-6fd5-4aa7-a8f1-72d54fc63584 req-13e3d2e0-c23d-413c-bff2-0aec1d21f20e service nova] Creating event network-changed:9f544325-972f-4e60-9365-73a4114a5bfb for instance 53f72561-f391-43d4-8264-28016993a6a5 on hv-cinder-85236 Aug 09 16:53:26.416709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-a297af06-6fd5-4aa7-a8f1-72d54fc63584 req-13e3d2e0-c23d-413c-bff2-0aec1d21f20e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032855 Aug 09 16:53:26.417307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 186/398] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:43.730937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=53 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:43.732046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=41 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:43.736110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "157d3d7c-8fba-41a8-8f7f-57bbb27b41dd", "device": "/dev/sdb"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:43.739629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:43.744712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:43.745200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:43.746233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:43.747032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:43.747523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:43.747953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:44.738804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a617dbab-51e5-4497-b7d5-6832abda8f9c tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "POST /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.009477 Aug 09 16:53:44.739542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 213/399] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:53:43 2022] POST /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45/os-volume_attachments => generated 194 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:53:54.962235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:54.963174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=89 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:54.967944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:53:54.968521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:54.974531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:54.976277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:54.976277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:54.976277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:54.976620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:54.976974 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:55.000627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7d94f478-635a-4c99-bacb-cd55d57918f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/ips" status: 200 len: 151 microversion: 2.20 time: 0.040018 Aug 09 16:53:55.001193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 187/400] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Aug 9 16:53:54 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:53:59.572156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:59.572934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:53:59.577420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:53:59.582102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:53:59.585221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:59.585709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:59.586147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:59.586845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:53:59.587422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:53:59.587855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:53:59.613904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lazy-loading 'flavor' on Instance uuid da7f4d33-f0b3-4448-9f68-813a5aead47a {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:00.249003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fa34df06-ed06-4bb0-a732-4648fd44ac8a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/action" status: 202 len: 0 microversion: 2.20 time: 0.678088 Aug 09 16:54:00.249697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 214/401] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 16:53:59 2022] POST /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:54:00.259180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:00.259816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:00.267499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:00.268071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:00.268505 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:00.269203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:00.269660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:00.270107 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:00.401302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:00.409124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:00.410696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:00.411941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a1d83fb6-3139-440d-a59a-3e6d7b3d2b7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.157250 Aug 09 16:54:00.412497 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 188/402] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:00 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:01.436538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:01.437228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:01.444747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:01.445167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:01.445597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:01.446278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:01.446721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:01.447165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:01.579239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:01.587049 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:01.588694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:01.589859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9fc70614-9a01-4d81-97c9-094c386602d5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.158134 Aug 09 16:54:01.590421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 215/403] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:01 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:02.614119 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:02.614707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:02.621096 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:02.621567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:02.621994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:02.622675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:02.623148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:02.623563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:02.757733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:02.766392 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:02.767957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:02.769328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-252419d4-0661-4499-a9d6-814f4de2c6f9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.160122 Aug 09 16:54:02.772288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 189/404] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:02 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:03.793530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:03.794096 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:03.801580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:03.802372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:03.802811 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:03.803535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:03.803988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:03.804410 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:03.936171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:03.944436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:03.945929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:03.947164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-02a3c22c-73ae-46ad-aa54-4e8bfe118fb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.157748 Aug 09 16:54:03.947723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 216/405] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:03 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:04.970676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:04.971315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:04.977725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:04.978196 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:04.978625 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:04.979341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:04.979788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:04.980207 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:05.114135 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:05.122361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:05.123875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:05.125030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6ff620e1-3d36-4b65-b731-c378266a8c64 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.159098 Aug 09 16:54:05.125583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 190/406] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:04 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:06.148661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:06.149302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:06.155830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:06.157579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:06.157579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:06.157579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:06.157998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:06.158430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:06.288323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:06.296182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:06.298042 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:06.299227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7173e8cf-b648-4ce7-8813-d3e9021bb486 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.154455 Aug 09 16:54:06.299786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 217/407] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:06 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:07.322764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:07.323474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:07.330273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:07.330747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:07.331212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:07.331899 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:07.332349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:07.332769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:07.461777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:07.470737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:07.472343 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:07.473558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3ffab45a-5a71-4c49-992a-55c76e4c58da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.154758 Aug 09 16:54:07.474124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 191/408] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:07 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:08.497762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:08.498352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:08.505402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:08.505896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:08.506335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:08.507022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:08.507506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:08.507936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:08.643003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:08.651097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:08.652624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:08.653787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d60572db-f464-4950-929e-0fbe205dcddf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.160275 Aug 09 16:54:08.654465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 218/409] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:08 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:09.677587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:09.678172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:09.684549 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:09.685029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:09.685463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:09.686150 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:09.686607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:09.687034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:09.822476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:09.830465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:09.831970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:09.833126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ef305c6f-cf83-46d8-ac32-ffbbe2434bef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.160059 Aug 09 16:54:09.833683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 192/410] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:09 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:10.856177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:10.856793 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:10.864063 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:10.864546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:10.864981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:10.865668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:10.866123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:10.866547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:10.996256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:11.004582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:11.006088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:11.007297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-14c32ef3-9ade-4141-b853-4cc99a38c029 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.154909 Aug 09 16:54:11.007874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 219/411] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:10 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:11.855439 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:11.855940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:11.862834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:11.863361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:11.863798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:11.864494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:11.864951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:11.865378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:11.991804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lazy-loading 'services' on Instance uuid c924ba86-e6ed-4312-9149-cd13ffd2af45 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:12.031130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:12.031864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:12.038838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:12.039372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:12.039802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:12.040495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:12.040945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:12.041362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:12.185913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:12.194402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:12.195924 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:12.197179 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8baa7efb-6d8f-405e-8afc-b850fbe0d19e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.170081 Aug 09 16:54:12.197732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 220/412] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:12 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:12.261465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b42481a8-4f8d-40da-bddf-b01ad3fa8060 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45/os-volume_attachments/157d3d7c-8fba-41a8-8f7f-57bbb27b41dd" status: 202 len: 0 microversion: 2.1 time: 0.409891 Aug 09 16:54:12.262189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 193/413] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:54:11 2022] DELETE /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45/os-volume_attachments/157d3d7c-8fba-41a8-8f7f-57bbb27b41dd => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:54:13.219283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:13.219894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:13.227208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:13.227691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:13.228127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:13.228953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:13.229408 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:13.229831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:13.363343 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:13.372094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:13.373594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:13.374798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cf6a2f63-d2a1-497b-88b8-6f1ca42622e7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.159552 Aug 09 16:54:13.379126 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 221/414] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:13 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:14.398157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:14.398979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:14.405113 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:14.410972 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:14.410972 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:14.410972 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:14.410972 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:14.411488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:14.446564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:14.447120 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:14.454106 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:14.454815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:14.455600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:14.456642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:14.457098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:14.457520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:14.484167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:54:14.546556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:14.555406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:14.557012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:14.558174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-44c448dd-5e89-410e-88ba-fe70fff776b1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.165048 Aug 09 16:54:14.558726 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 194/415] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:14 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:14.862698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a54a3f27-4edd-489b-8733-25b187f76d77 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 204 len: 0 microversion: 2.1 time: 0.419297 Aug 09 16:54:14.863230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 222/416] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:54:14 2022] DELETE /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 16:54:14.871556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:14.872174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:14.878223 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:14.878639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:14.879073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:14.879800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:14.880259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:14.880683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:15.012221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:15.020367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-641d333a-7250-4d81-856c-49c8eeb875ac tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1514 microversion: 2.1 time: 0.152677 Aug 09 16:54:15.020930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 195/417] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:14 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:15.583045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:15.583768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:15.590724 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:15.591233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:15.591665 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:15.592458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:15.592906 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:15.593327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:15.725767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:15.733859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:15.735383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:15.736541 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5b4a060e-04f5-4b96-ba2c-853f8814daa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.158270 Aug 09 16:54:15.737893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 223/418] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:15 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:16.041182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:16.041785 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:16.048668 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:16.049154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:16.049600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:16.050437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:16.050889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:16.051346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:16.184881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:16.192838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-90b1e4c6-afba-4a5a-bebf-8b5a57510168 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1514 microversion: 2.1 time: 0.155609 Aug 09 16:54:16.193417 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 196/419] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:16 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:16.759957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:16.760572 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:16.767067 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:16.767588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:16.768192 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:16.769395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:16.769855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:16.770285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:16.905295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:16.916119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:16.918442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:16.919661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b355a4ea-bb15-4e85-bd62-738101654eb7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.163734 Aug 09 16:54:16.920228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 224/420] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:16 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:17.214004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:17.214615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:17.221301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:17.221787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:17.222224 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:17.222913 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:17.223440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:17.223862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:17.358935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:17.367995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7443e92c-93e1-428c-be69-8a3d7cc0f005 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1514 microversion: 2.1 time: 0.157871 Aug 09 16:54:17.368998 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 197/421] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:17 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:17.944353 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:17.944939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:17.951378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:17.951845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:17.952310 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:17.953005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:17.953460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:17.953932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:18.085727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:18.093691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:18.095201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:18.097551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-aca13304-6c5d-4637-a12a-dd9b25bc87f7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.156940 Aug 09 16:54:18.098526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 225/422] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:17 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:18.389052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:18.389672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:18.396777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:18.397267 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:18.397701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:18.398392 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:18.398850 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:18.399321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:18.591132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-f84754f6-a932-4ec5-b5c3-806afe388ea2 req-fa461a8a-2530-4e24-8c92-e781a15aabc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c924ba86-e6ed-4312-9149-cd13ffd2af45", "name": "network-vif-deleted", "tag": "d1b97e7d-8dd6-48df-af38-15a732a256dc"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:18.601277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-f84754f6-a932-4ec5-b5c3-806afe388ea2 req-fa461a8a-2530-4e24-8c92-e781a15aabc8 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:18.601756 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-f84754f6-a932-4ec5-b5c3-806afe388ea2 req-fa461a8a-2530-4e24-8c92-e781a15aabc8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:18.602186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-f84754f6-a932-4ec5-b5c3-806afe388ea2 req-fa461a8a-2530-4e24-8c92-e781a15aabc8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:18.616355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-f84754f6-a932-4ec5-b5c3-806afe388ea2 req-fa461a8a-2530-4e24-8c92-e781a15aabc8 service nova] Creating event network-vif-deleted:d1b97e7d-8dd6-48df-af38-15a732a256dc for instance c924ba86-e6ed-4312-9149-cd13ffd2af45 on hv-cinder-85236 Aug 09 16:54:18.616513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:18.621598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-f84754f6-a932-4ec5-b5c3-806afe388ea2 req-fa461a8a-2530-4e24-8c92-e781a15aabc8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Aug 09 16:54:18.622204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 226/423] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:18.626697 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-20f76d96-cab1-4f53-968a-acf4f89d9769 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1514 microversion: 2.1 time: 0.240913 Aug 09 16:54:18.627021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 198/424] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:18 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:19.121865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:19.122568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:19.129115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:19.129596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:19.130032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:19.130726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:19.131242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:19.131656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:19.149566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:19.265382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:19.273831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:19.275405 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:19.276563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-61dff27c-b045-40c4-bfb0-ee4b5c91c995 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.159560 Aug 09 16:54:19.277187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 227/425] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:19 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:19.648642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:19.649177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:19.655466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:19.655943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:19.656375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:19.657059 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:19.657511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:19.657929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:19.689482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:19.689954 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:19.690926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:19.691389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lazy-loading 'fault' on Instance uuid c924ba86-e6ed-4312-9149-cd13ffd2af45 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:19.737847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:19.745225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6d547107-db4a-4f82-b43a-00b5ed44eee7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 200 len: 1309 microversion: 2.1 time: 0.100447 Aug 09 16:54:19.745783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 199/426] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:19 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:20.303441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:20.303994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:20.310767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:20.311309 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:20.311746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:20.312475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:20.312932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:20.313360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:20.450751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:20.458832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:20.460369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:20.461549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3206cc69-31f6-4bea-bd19-c7d9f6460bd5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.163221 Aug 09 16:54:20.462113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 228/427] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:20 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:20.766240 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:20.766841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: c924ba86-e6ed-4312-9149-cd13ffd2af45] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:20.773818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:20.774296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:20.774735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:20.775448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:20.775899 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:20.776318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:20.790511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] HTTP exception thrown: Instance c924ba86-e6ed-4312-9149-cd13ffd2af45 could not be found. Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Request method failure captured: Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 HTTP/1.1 Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pDg6sLrCa2rmltyk-_IA1vlQoTtwcmW7zdbXBjfPaV-BprzyKqH8kDGzHSA-0dwvEBP4-jjOPTsoc3H1kekDKVS0AlwIEgEvCUW7ll6bTI0P1T9gLz7i8aYFaYoQlXzpaqz_jkeCAZuwLPWahQrzPBdVTGrimm3CXY1PVsb89Klb-E Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 7ea828531a5d468a9f15381d47e1594e Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesSnapshotTestJSON-308951325 Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:54:20.792225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ea828531a5d468a9f15381d47e1594e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7ea828531a5d468a9f15381d47e1594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7ea828531a5d468a9f15381d47e1594e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ea828531a5d468a9f15381d47e1594e"}]}] Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesSnapshotTestJSON-308951325 Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 7ea828531a5d468a9f15381d47e1594e Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-308951325 Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesSnapshotTestJSON-308951325-project Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 88960dd0da2c4bb39e4fc1f773636231 Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesSnapshotTestJSON-308951325-project Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance c924ba86-e6ed-4312-9149-cd13ffd2af45 could not be found. Aug 09 16:54:20.793919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'c924ba86-e6ed-4312-9149-cd13ffd2af45'} Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c924ba86-e6ed-4312-9149-cd13ffd2af45 could not be found. Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:20.794795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c924ba86-e6ed-4312-9149-cd13ffd2af45 could not be found. Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c924ba86-e6ed-4312-9149-cd13ffd2af45 could not be found. Aug 09 16:54:20.796330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:20.797618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Returning 404 to user: Instance c924ba86-e6ed-4312-9149-cd13ffd2af45 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:20.797618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3be08302-0838-404e-bc72-3794d7593bf8 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45" status: 404 len: 111 microversion: 2.1 time: 0.031367 Aug 09 16:54:20.797618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 200/428] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:20 2022] GET /compute/v2.1/servers/c924ba86-e6ed-4312-9149-cd13ffd2af45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:54:21.485318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:21.485931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:21.493190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:21.493749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:21.494187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:21.494904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:21.495401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:21.495826 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:21.623270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:21.631898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:21.633378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:21.634519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9f0c3abf-67b8-4a9b-bd9b-2ea81a64641a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.153155 Aug 09 16:54:21.635075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 229/429] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:21 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:22.656566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:22.657181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:22.663771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:22.664252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:22.668347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:22.668347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:22.668347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:22.668347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:22.793743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:22.802019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:22.803560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:22.804713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9151ad5c-c0c6-49b3-ae62-2c432f4dab6a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.152049 Aug 09 16:54:22.805266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 201/430] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:22 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:23.828615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:23.829284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:23.836063 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:23.836532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:23.836968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:23.837653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:23.838104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:23.838528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:23.968996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:23.976898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:23.978441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:23.979640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-81f76789-435b-4848-8b05-4122c95927e5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.154908 Aug 09 16:54:23.980202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 230/431] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:23 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:25.002203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:25.002842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:25.009517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:25.009973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:25.010410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:25.011127 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:25.011592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:25.012052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:25.142706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:25.151491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:25.153006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:25.154253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fcaf2e8f-1790-4d05-8177-787701c5f05f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.156053 Aug 09 16:54:25.154898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 202/432] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:24 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:26.178079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:26.178673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:26.185103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:26.185582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:26.186016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:26.186701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:26.187174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:26.187602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:26.316708 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:26.324528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:26.326023 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:26.327196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-528638f0-9eac-4752-83fb-79c06693ca06 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1744 microversion: 2.20 time: 0.153317 Aug 09 16:54:26.327757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 231/433] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:26 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:27.165914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:27.166556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:27.172879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:27.176293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:27.176293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:27.176293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:27.176293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:27.176819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:27.197867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:27.264023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lazy-loading 'services' on Instance uuid e7a274d0-9d37-4f6f-8a7e-2f223cf42198 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:27.350430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:27.351043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:27.357514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:27.358006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:27.358440 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:27.359194 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:27.359656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:27.360079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:27.499038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2c800460-b5c7-466d-8d11-b02a0e65e1c4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-volume_attachments/301fc146-4fc9-4771-994e-48c21d11b2b2" status: 202 len: 0 microversion: 2.1 time: 0.338915 Aug 09 16:54:27.500120 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 203/434] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:54:27 2022] DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-volume_attachments/301fc146-4fc9-4771-994e-48c21d11b2b2 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:54:27.506930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:27.517462 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:27.519964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:27.521335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a9d634be-f63f-41b0-a4c0-4c822936e97d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1744 microversion: 2.20 time: 0.175450 Aug 09 16:54:27.521897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 232/435] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:27 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:28.550548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:28.551300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:28.557509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:28.557994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:28.558426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:28.559135 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:28.559597 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:28.560021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:28.695509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:28.703765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:28.705264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:28.706429 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c374f856-b594-40bd-95f1-b32ae683c87b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1744 microversion: 2.20 time: 0.160355 Aug 09 16:54:28.708414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 204/436] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:28 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:29.731141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:29.731765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:29.734127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:29.738739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:29.739355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:29.739880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:29.740571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:29.741024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:29.741457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:29.868407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:29.876182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:29.877676 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:29.878836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fea893f6-f3f4-4ccd-9cfe-8b5a4f6d1b6c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1744 microversion: 2.20 time: 0.151597 Aug 09 16:54:29.879447 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 233/437] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:29 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:30.902661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:30.903300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:30.905701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=39 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:30.910258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:30.910773 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:30.911260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:30.911947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:30.912396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:30.912818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:31.049406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:31.057474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:31.058961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:31.060264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4f51f9e2-4693-4aab-9522-511a35232296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1744 microversion: 2.20 time: 0.161386 Aug 09 16:54:31.060821 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 205/438] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:30 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:32.085501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:32.086056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:32.092205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:32.092695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:32.093137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:32.093831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:32.094291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:32.094720 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:32.238553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:32.247574 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:32.249340 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:32.250706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-efe8b939-f6db-4f25-817d-54399733c0b5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1744 microversion: 2.20 time: 0.169774 Aug 09 16:54:32.251366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 234/439] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:32 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:32.297995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-a04b63dc-1e61-49fd-bde7-c4d07bb7c390 req-55002f31-88f1-4ab5-8975-b4cb313f7fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "name": "network-vif-plugged", "status": "completed", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:32.306936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a04b63dc-1e61-49fd-bde7-c4d07bb7c390 req-55002f31-88f1-4ab5-8975-b4cb313f7fca service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:32.307441 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a04b63dc-1e61-49fd-bde7-c4d07bb7c390 req-55002f31-88f1-4ab5-8975-b4cb313f7fca service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:32.307872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a04b63dc-1e61-49fd-bde7-c4d07bb7c390 req-55002f31-88f1-4ab5-8975-b4cb313f7fca service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:32.320084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-a04b63dc-1e61-49fd-bde7-c4d07bb7c390 req-55002f31-88f1-4ab5-8975-b4cb313f7fca service nova] Creating event network-vif-plugged:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:54:32.325376 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-a04b63dc-1e61-49fd-bde7-c4d07bb7c390 req-55002f31-88f1-4ab5-8975-b4cb313f7fca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033444 Aug 09 16:54:32.326145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 206/440] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:32.854710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-515c6810-f381-4a23-9fe1-c9a179cce632 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:32.860858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-515c6810-f381-4a23-9fe1-c9a179cce632 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:32.861346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-515c6810-f381-4a23-9fe1-c9a179cce632 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:32.861785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-515c6810-f381-4a23-9fe1-c9a179cce632 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:32.887271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-515c6810-f381-4a23-9fe1-c9a179cce632 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Going to try to stop instance {{(pid=124900) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 16:54:33.112277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-515c6810-f381-4a23-9fe1-c9a179cce632 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action" status: 202 len: 0 microversion: 2.1 time: 0.261304 Aug 09 16:54:33.117265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 235/441] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:54:32 2022] POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:54:33.123115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:33.123580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:33.129769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:33.130512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:33.130940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:33.131661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:33.132116 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:33.132534 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:33.275204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:33.276114 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:33.282436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:33.283011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:33.283478 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:33.284184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:33.284633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:33.285051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:33.480381 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:33.494472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:33.497082 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:33.498734 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-731984ed-95cb-463b-b603-d83ba5551a3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.228427 Aug 09 16:54:33.499993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 236/442] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:33 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:33.511838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-318965884", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "networks": [{"uuid": "e3964af6-46ca-431b-afc6-d66481e46704"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:33.568870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:33.579507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-158f8fa3-ea88-4195-939a-cf79c14fb6f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.460437 Aug 09 16:54:33.580871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 207/443] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:33 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:33.610008 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] validate_networks() for [('e3964af6-46ca-431b-afc6-d66481e46704', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:54:33.941524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:33.943084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:33.949621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:33.950104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:33.951588 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:33.952490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:33.953276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:33.953854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:33.983536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-def8fb4c-ffca-404a-b478-9cb7e88b6585 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/ips" status: 200 len: 149 microversion: 2.1 time: 0.045935 Aug 09 16:54:33.984726 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 208/444] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:54:33 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:54:33.997020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:54:33.997195 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b58234-eabf-47d3-b515-bbf849158dd5"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:33.997669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:54:33.999213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:54:33.999213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:54:33.999444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:54:33.999548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:34.010976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.011717 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.013758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.013758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.013758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.013758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.023279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.024155 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.024758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.025891 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.026553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.027174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.032626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Getting quotas for project 7ea828531a5d468a9f15381d47e1594e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:54:34.048522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Getting quotas for user 88960dd0da2c4bb39e4fc1f773636231 and project 7ea828531a5d468a9f15381d47e1594e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:54:34.063392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:54:34.065981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:54:34.132546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Invalid volume: volume 99b58234-eabf-47d3-b515-bbf849158dd5 is already attached to instances: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: POST /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/os-volume_attachments HTTP/1.1 Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 74 Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:54:34.139364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {"volumeAttachment": {"volumeId": "99b58234-eabf-47d3-b515-bbf849158dd5"}} Aug 09 16:54:34.142536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Invalid volume: volume 99b58234-eabf-47d3-b515-bbf849158dd5 is already attached to instances: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'server_id': 'cb82bef7-ce2f-4541-b695-2b1769932f23', 'body': {'volumeAttachment': {'volumeId': '99b58234-eabf-47d3-b515-bbf849158dd5'}}} Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99b58234-eabf-47d3-b515-bbf849158dd5 is already attached to instances: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:34.143624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99b58234-eabf-47d3-b515-bbf849158dd5 is already attached to instances: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:34.145037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99b58234-eabf-47d3-b515-bbf849158dd5 is already attached to instances: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 400 to user: Invalid volume: volume 99b58234-eabf-47d3-b515-bbf849158dd5 is already attached to instances: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c2cb90f1-1910-4396-91a7-3c6d345b26e9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.148688 Aug 09 16:54:34.147715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 209/445] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:54:33 2022] POST /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 16:54:34.152473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:34.153132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:34.162787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.163444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.163881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.164782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.165486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.166206 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.194218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:54:34.271402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f7f21083-55f1-4924-8c55-45a961faacdc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769921 Aug 09 16:54:34.272055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 237/446] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:54:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:54:34.282695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-737c9191-f2b8-4ac0-bea1-68841e951360 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:34.283349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-737c9191-f2b8-4ac0-bea1-68841e951360 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:34.376845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-737c9191-f2b8-4ac0-bea1-68841e951360 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:34.386983 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-737c9191-f2b8-4ac0-bea1-68841e951360 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1218 microversion: 2.1 time: 0.107954 Aug 09 16:54:34.388428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 238/447] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:34 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:34.522165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:34.522802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:34.529768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.531144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.531806 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.533155 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.533840 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.534341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.571927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a1b63037-87f0-4126-a3f6-c997d2fc8837 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 204 len: 0 microversion: 2.1 time: 0.423733 Aug 09 16:54:34.573105 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 210/448] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:54:34 2022] DELETE /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 16:54:34.581366 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:34.582336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:34.603348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.603846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.604289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.607264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.607741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.609978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.737570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:34.750858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:34.753887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:34.756753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-407a87ab-07e9-4323-8aa9-db8ab12d82e8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.238422 Aug 09 16:54:34.757815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 239/449] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:34 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:34.763091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:34.763911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:34.782301 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.784542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.784542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.784542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:34.784819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:34.785041 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:34.798865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:34.810110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d76db928-a776-4f02-85c1-90b6dff906c3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1681 microversion: 2.1 time: 0.232784 Aug 09 16:54:34.810852 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 211/450] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:34 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:34.950197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:34.958399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e4a4af55-f9cb-4a79-b2c2-d6e23717822d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.199033 Aug 09 16:54:34.959349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 240/451] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:34 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:35.427795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6b626800-3702-457e-8f67-6b446515ddce tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:35.428784 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6b626800-3702-457e-8f67-6b446515ddce tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:35.532312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6b626800-3702-457e-8f67-6b446515ddce tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:35.540858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6b626800-3702-457e-8f67-6b446515ddce tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1218 microversion: 2.1 time: 0.135721 Aug 09 16:54:35.541738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 212/452] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:35 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:35.782660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:35.783271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:35.790810 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:35.791931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:35.792651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:35.793975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:35.794632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:35.795402 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:35.839372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:35.840947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:35.852589 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:35.855804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:35.856266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:35.857203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:35.857682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:35.869449 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:35.967033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:35.984363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:35.987857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:35.991378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3cc11e55-71ff-4551-a000-a2cb81435f2d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.210691 Aug 09 16:54:35.992250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 241/453] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:35 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:36.003231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:36.008353 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:36.016773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:36.017572 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:36.018233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:36.019275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:36.019814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:36.020878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:36.045312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:36.053026 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d3db9d0a-0e4b-44c7-ba0d-e97f3ee7808b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1681 microversion: 2.1 time: 0.218180 Aug 09 16:54:36.068318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 213/454] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:35 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:36.198657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:36.206579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-edd2e344-95a4-4559-8f5d-6c2cfab5a095 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.213592 Aug 09 16:54:36.207195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 242/455] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:35 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:36.563015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:36.563648 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:36.572921 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:36.573400 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:36.573829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:36.574515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:36.574962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:36.575418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:36.639821 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:36.650030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9c34a937-cf19-454d-9886-eadc6a223b3f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1222 microversion: 2.1 time: 0.090532 Aug 09 16:54:36.650774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 214/456] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:36 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:37.016581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:37.017928 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:37.028104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.034433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.034433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.034433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.034433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.034859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.075867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:37.077198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:37.084003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.085037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.085677 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.086701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.087741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.088349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.229111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:37.245312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:37.246852 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:37.248156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c9d05cb9-b0b8-4602-9f38-c10927d39bf1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.235666 Aug 09 16:54:37.263865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 243/457] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:37 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:37.263865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:37.263865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:37.263865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.263865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.264413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.264413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.264413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.266715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.305956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:37.315169 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a6046a44-62c7-4b3d-8fae-10e3f0409af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1681 microversion: 2.1 time: 0.242871 Aug 09 16:54:37.335523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 215/458] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:37 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:37.463807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:37.470603 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:37.475917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fea22b39-2317-4718-9223-a47a0b6ef525 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.225741 Aug 09 16:54:37.482435 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 244/459] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:37 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:37.676855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:37.676855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:37.685875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.690454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.690454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.697047 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:37.697884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:37.698692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:37.821655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:37.835800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-998eb99f-a20e-4958-9b47-ec86d90ff2a7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1270 microversion: 2.1 time: 0.165098 Aug 09 16:54:37.847180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 216/460] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:37 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:38.278242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:38.278831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:38.285654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.286173 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.286597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.287330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.287781 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.288349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.338799 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:38.339605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:38.349761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.350284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.350717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.352211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.352768 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.356129 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.470206 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:38.484441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:38.486000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:38.487355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-524ef8e3-5fd0-4562-b952-9df8d38bf708 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.215877 Aug 09 16:54:38.488217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 245/461] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:38 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:38.507193 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:38.508260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:38.516642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.522549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.522549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.522549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.522549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.522968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.701532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:38.711865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-784b7c55-30e8-4a47-9c07-54915a0a8006 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.211962 Aug 09 16:54:38.728242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 246/462] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:38 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:38.736492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:38.751147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c3197345-c789-414d-84e6-7d2b73915f53 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1681 microversion: 2.1 time: 0.416325 Aug 09 16:54:38.751732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 217/463] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:38 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1681 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:38.858307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:38.858981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:38.868424 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.868909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.869348 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:38.870110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:38.870571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:38.871000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:39.135201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-deb66fb7-35b2-4914-94e7-7e7698571ea9 req-e2314516-9f00-4251-ac5c-fd3efe9929e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb82bef7-ce2f-4541-b695-2b1769932f23", "name": "network-vif-deleted", "tag": "4a3e69ee-936d-4754-9dde-3c621ceacfcf"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:39.166810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-deb66fb7-35b2-4914-94e7-7e7698571ea9 req-e2314516-9f00-4251-ac5c-fd3efe9929e7 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:39.167701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-deb66fb7-35b2-4914-94e7-7e7698571ea9 req-e2314516-9f00-4251-ac5c-fd3efe9929e7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:39.168194 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-deb66fb7-35b2-4914-94e7-7e7698571ea9 req-e2314516-9f00-4251-ac5c-fd3efe9929e7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:39.181106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-deb66fb7-35b2-4914-94e7-7e7698571ea9 req-e2314516-9f00-4251-ac5c-fd3efe9929e7 service nova] Creating event network-vif-deleted:4a3e69ee-936d-4754-9dde-3c621ceacfcf for instance cb82bef7-ce2f-4541-b695-2b1769932f23 on hv-cinder-85236 Aug 09 16:54:39.186813 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-deb66fb7-35b2-4914-94e7-7e7698571ea9 req-e2314516-9f00-4251-ac5c-fd3efe9929e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055533 Aug 09 16:54:39.193192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 218/464] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:39.476775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:39.485266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9ee155c0-1229-418a-927b-3e0d127a3766 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1288 microversion: 2.1 time: 0.630818 Aug 09 16:54:39.485888 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 247/465] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:38 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1288 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:39.513976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:39.515350 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:39.546711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:39.547518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:39.548136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:39.549003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:39.549615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:39.550193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:39.733259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:39.734195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:39.740709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:39.750691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:39.751714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:39.755032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:39.758615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:39.769932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:39.994755 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:40.035433 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:40.038061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:40.043301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-28409dea-1dc8-4fee-8dd8-febf93bec4cc tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.533154 Aug 09 16:54:40.044736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 219/466] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:39 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:40.070814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:40.074422 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:40.086865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:40.089845 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:40.090528 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:40.092149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:40.092771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:40.094206 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:40.140787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:40.141602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:40.152599 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3bd94325-a83f-4eb6-9271-b3ca3e679500 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.421764 Aug 09 16:54:40.154302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 248/467] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:39 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:40.185440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:40.186243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:40.191709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:40.191709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'fault' on Instance uuid cb82bef7-ce2f-4541-b695-2b1769932f23 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:40.288367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:40.312187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0c896fbc-a4fc-4f8b-9be6-480c8fd5012c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 200 len: 1332 microversion: 2.1 time: 0.247841 Aug 09 16:54:40.312187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 220/468] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:40 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:40.511392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:40.513386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:40.520011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:40.521264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:40.521703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:40.522954 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:40.523750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:40.524190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:40.682347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:40.690544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c6adf8ca-bda8-4029-a71e-6ed6af23c527 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.183799 Aug 09 16:54:40.691142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 249/469] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:40 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:41.076748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.077538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:41.100752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.102264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.104565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.105539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.106326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.106949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.183844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.184621 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:41.197778 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.206243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.206243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.206243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.206243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.206863 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.412463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:41.431937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7ca95ebc-cbe9-4505-912b-ef5b071d4e1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.252175 Aug 09 16:54:41.447324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:41.450050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 250/470] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:41 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:41.457953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:41.459229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.460162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:41.463712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:41.483352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-63e5246a-1bfc-4afd-ae7a-e8f905f42875 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.394532 Aug 09 16:54:41.483352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 221/471] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:41 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:41.483718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.483718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.483718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.484952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.486228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.486738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.515547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 HTTP/1.1 Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:54:41.517702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:54:41.519157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'cb82bef7-ce2f-4541-b695-2b1769932f23'} Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:41.519902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:54:41.522020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:41.524296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:41.524296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d0c02957-0ed8-47c3-86ff-eca8735dfd24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 404 len: 111 microversion: 2.1 time: 0.067826 Aug 09 16:54:41.524296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 251/472] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:41 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:54:41.528144 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-51f1c577-3d14-4b27-b6b7-35e2d7ee13ce tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '.version_select at 0x7fccc4cc4ca0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.613184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-51f1c577-3d14-4b27-b6b7-35e2d7ee13ce tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125425889" status: 202 len: 0 microversion: 2.1 time: 0.088733 Aug 09 16:54:41.614629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 222/473] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 16:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125425889 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:54:41.717414 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:41.721612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:41.732334 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.732875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.733299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.734023 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:41.740636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:41.741102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:41.969039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:41.978053 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d4b1b637-3566-4e95-8726-186bdae8f06b tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.267412 Aug 09 16:54:41.979787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 252/474] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:41 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:42.284527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-f789a39f-6a59-4551-a8fd-fbf43a1eb05b req-bfbc4425-bf69-4cf1-bda2-9c9599562f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a826f525-18be-4776-9042-856d0854971e", "tag": "259f97dc-abea-4d59-9f06-f3de84cf5fd5"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:42.318073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-f789a39f-6a59-4551-a8fd-fbf43a1eb05b req-bfbc4425-bf69-4cf1-bda2-9c9599562f77 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:42.319526 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-f789a39f-6a59-4551-a8fd-fbf43a1eb05b req-bfbc4425-bf69-4cf1-bda2-9c9599562f77 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:42.320141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-f789a39f-6a59-4551-a8fd-fbf43a1eb05b req-bfbc4425-bf69-4cf1-bda2-9c9599562f77 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:42.356914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-f789a39f-6a59-4551-a8fd-fbf43a1eb05b req-bfbc4425-bf69-4cf1-bda2-9c9599562f77 service nova] Creating event network-changed:259f97dc-abea-4d59-9f06-f3de84cf5fd5 for instance a826f525-18be-4776-9042-856d0854971e on hv-cinder-85236 Aug 09 16:54:42.371012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-f789a39f-6a59-4551-a8fd-fbf43a1eb05b req-bfbc4425-bf69-4cf1-bda2-9c9599562f77 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090390 Aug 09 16:54:42.374052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 223/475] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:42.469968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.470589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:42.484001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:42.484580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:42.485036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:42.485710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:42.486817 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:42.488061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:42.509076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:42.511091 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:42.517848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:42.518574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:42.519324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:42.522103 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:42.523141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:42.523731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:42.712883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:42.725169 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c2e858e1-5910-4cd0-959e-d6db9ee84d28 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.260726 Aug 09 16:54:42.740141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 253/476] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:42.929862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:42.950901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:42.952447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:42.953643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-de8fc11c-f259-4659-bd62-1a2456dfa9d3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.458217 Aug 09 16:54:42.954202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 224/477] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:43.000681 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:43.006839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:43.007847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:43.009302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:43.020008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.024043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.024453 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.025115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.026217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.027230 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.027918 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.029008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.029790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.030556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.031254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.033138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.209961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'services' on Instance uuid 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:43.491583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5fa0d794-b88a-44f6-a744-18e0f525c13c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments/99b58234-eabf-47d3-b515-bbf849158dd5" status: 202 len: 0 microversion: 2.1 time: 0.495320 Aug 09 16:54:43.492602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 254/478] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:54:42 2022] DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments/99b58234-eabf-47d3-b515-bbf849158dd5 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:54:43.507331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:43.512666 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:43.524909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.525544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.526159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.527037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.527619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.531628 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.566406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d67b10fe-8398-4add-8a6e-4e2a01c4bee6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069287 Aug 09 16:54:43.571908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 255/479] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:54:43 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:43.601121 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:43.631554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-656dd003-7a24-4a9c-92b8-f15270906dc7 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.634235 Aug 09 16:54:43.644357 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 225/480] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:42 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:43.747809 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:43.748433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:43.754710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.755500 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.761327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.765006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.765548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.766065 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.937404 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:43.945799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e056be36-3a4c-46d3-9277-33fdf90f9c6a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.202156 Aug 09 16:54:43.954338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 256/481] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:43 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:43.983404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:43.984007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:43.992809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.993294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.993802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:43.994498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:43.994947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:43.995381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:44.193077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:44.193077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:44.193364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:44.193364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e56b545e-2e8a-4523-a609-4525eaafb538 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.180625 Aug 09 16:54:44.193364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 226/482] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:43 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:44.579649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:44.581754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:44.588908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:44.590495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=8 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:44.595029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:44.595548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:44.596186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:44.597097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:44.597558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:44.597990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:44.632661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-341f3824-c7bc-4c42-a05d-d14e67beec24 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056864 Aug 09 16:54:44.633254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 257/483] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:54:44 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:44.653308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:44.654016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:44.660581 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:44.661231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:44.661702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:44.662392 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:44.662850 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:44.663330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:44.811354 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:44.821102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1d422309-9a74-4403-b81f-9615e5f1eaa4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.171519 Aug 09 16:54:44.821745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 227/484] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:44 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:44.968372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:44.968951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:44.976619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:44.977305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:44.977917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:44.978619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:44.979261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:44.979942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.138595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:45.148215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-69911f50-46b4-42f2-add5-04a3da563d20 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.183471 Aug 09 16:54:45.148948 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 258/485] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:44 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:45.205802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:45.206599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:45.212718 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:45.213199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:45.213626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.214312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:45.214952 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:45.215406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.358905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:45.367818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:45.369338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:45.370551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-40157245-f89c-4e57-9282-b7acffe74564 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.168607 Aug 09 16:54:45.371144 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 228/486] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:45 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:45.645069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:45.648013 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:45.655170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:45.657981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:45.657981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.657981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:45.657981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:45.658333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.686838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b86154e5-531d-4f0b-87dc-8ea036f47978 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Aug 09 16:54:45.687505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 259/487] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:54:45 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:45.844053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:45.844625 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:45.846592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:45.852317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:45.854797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:45.854797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.854797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:45.855204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:45.855312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:45.985540 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:45.993176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-79f23194-a631-47b4-ae8a-f24e76afdf58 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.153071 Aug 09 16:54:45.993733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 229/488] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:45 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:46.170843 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:46.171474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:46.177331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:46.178874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:46.179341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:46.180031 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:46.180481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:46.180902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:46.314668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:46.323128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-554badcd-f6ae-4d3d-9055-d3ee39622dd9 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.156011 Aug 09 16:54:46.323716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 260/489] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:46 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:46.395786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:46.396692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:46.402658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:46.403158 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:46.403595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:46.404285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:46.404738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:46.405161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:46.538699 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:46.546778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:46.548328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:46.549493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-06896ef5-7b45-451d-ac56-62242b439b1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1739 microversion: 2.20 time: 0.157534 Aug 09 16:54:46.550086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 230/490] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:46 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:46.700053 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:46.702117 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:46.708438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:46.709076 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:46.709574 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:46.710260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:46.710717 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:46.711161 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:46.731051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:46.744866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-35357b95-9b7d-4e65-8c5a-d5acde8b0918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048865 Aug 09 16:54:46.745425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 261/491] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:54:46 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:47.013887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:47.014441 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:47.020881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.021888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.022321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.023193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.023656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.024059 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.172628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:47.180700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d9ff7c45-90df-4fdf-80c1-095554ce7c82 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.170649 Aug 09 16:54:47.181537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 231/492] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:47 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:47.343898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:47.344527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:47.351566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.352044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.352474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.353427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.354204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.354376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.487303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:47.495561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4f24fda9-5de3-4077-848e-4180fdd5f3fa tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.155394 Aug 09 16:54:47.496137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 262/493] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:47 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:47.573658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:47.574275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:47.580286 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.580709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.581146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.581833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.582289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.582809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.757955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:47.760523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:47.766830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.767360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.767795 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.768492 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.769220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.769657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.794019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:47.799399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6bfc590e-b805-4a8d-8de9-f4030f2866b3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046055 Aug 09 16:54:47.799994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 263/494] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:54:47 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 16:54:47.804022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:47.806707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:47.807979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-62b14801-d7ad-4090-af6b-cf7ae190cf20 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1721 microversion: 2.20 time: 0.238444 Aug 09 16:54:47.808778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 232/495] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:47 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:47.862787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:47.863327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:47.870002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.870587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.873039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.873039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.873039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.873039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.878745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cae8add1-f3cb-4ce8-a1ae-685db9c45c76"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:47.882137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:47.888594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.888791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.889322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.890094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:47.890621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:47.891140 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:47.899278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:54:48.223133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1dacedb7-c2fe-4fb9-bb07-11f501c71780 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 204 len: 0 microversion: 2.1 time: 0.363815 Aug 09 16:54:48.224029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 264/496] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:54:47 2022] DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:54:48.230917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:48.231640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:48.237457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.237998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.238432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.239150 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.239598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.240834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.383461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:48.395267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ab36a857-518a-4c13-bb19-bb3544745108 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.168436 Aug 09 16:54:48.395943 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 265/497] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:48 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:48.401364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:48.409333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:48.409333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.409333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.409822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.410290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.410760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.411238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.549917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:48.558582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c5401258-1282-477c-95a8-f5bbb348340c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1682 microversion: 2.1 time: 0.160998 Aug 09 16:54:48.559196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 266/498] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:48 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:48.565026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:48.565901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:48.573129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.573699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.574144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.574910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.575403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.575835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.706773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:48.712103 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3582d9eb-c5d7-4bb1-9249-50fbf34f4be9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837372 Aug 09 16:54:48.713173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 233/499] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:54:47 2022] POST /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:48.716586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2ccd7c36-dfa3-4a86-91d6-11030b7d7402 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.156367 Aug 09 16:54:48.717168 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 267/500] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:48 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:48.832405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:48.833097 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:48.839225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.839705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.840132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.840804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:48.841246 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:48.841661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:48.979631 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:48.987932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:48.989471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:48.991394 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-33abb360-2f57-4e5b-aaa8-a30b1f412b25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1721 microversion: 2.20 time: 0.163112 Aug 09 16:54:48.991896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 234/501] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:48 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:49.415638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:49.417022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:49.423644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:49.424162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:49.424602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:49.425301 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:49.425759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:49.426182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:49.558275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:49.565988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cb69333c-2101-4523-90cd-8e2b35a1597f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.154372 Aug 09 16:54:49.566556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 268/502] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:49 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:49.580792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:49.581522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:49.588824 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:49.589341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:49.589782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:49.590471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:49.590927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:49.591450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:49.721895 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:49.730010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-69cb9a73-618e-4328-9827-23625716d5c0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1682 microversion: 2.1 time: 0.153008 Aug 09 16:54:49.730575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 235/503] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:49 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:49.749836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:49.750461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:49.756378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:49.757441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:49.757894 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:49.758591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:49.759055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:49.759509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:49.892015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:49.900535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e6a89248-44a3-4385-9107-6a10ac17ecd5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.154397 Aug 09 16:54:49.901115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 269/504] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:49 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:50.013775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:50.014494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:50.020452 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.020943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.022036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.022783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.023262 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.023692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.154494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:50.162424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:50.164311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:50.165712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6f517e24-a330-4cd6-a612-f06368d29ab2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1721 microversion: 2.20 time: 0.155574 Aug 09 16:54:50.166350 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 236/505] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:50 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:50.586786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:50.587444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:50.593781 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.594263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.594699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.595422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.595882 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.596305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.672175 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-cca18c76-ac42-4e6d-8a26-10b580f47778 req-4ed25754-6009-46c2-8680-d61ca54ac6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a826f525-18be-4776-9042-856d0854971e", "name": "network-vif-plugged", "status": "completed", "tag": "259f97dc-abea-4d59-9f06-f3de84cf5fd5"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:50.682252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-cca18c76-ac42-4e6d-8a26-10b580f47778 req-4ed25754-6009-46c2-8680-d61ca54ac6bc service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.682924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-cca18c76-ac42-4e6d-8a26-10b580f47778 req-4ed25754-6009-46c2-8680-d61ca54ac6bc service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.683561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-cca18c76-ac42-4e6d-8a26-10b580f47778 req-4ed25754-6009-46c2-8680-d61ca54ac6bc service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.687662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:50.695245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-cca18c76-ac42-4e6d-8a26-10b580f47778 req-4ed25754-6009-46c2-8680-d61ca54ac6bc service nova] Creating event network-vif-plugged:259f97dc-abea-4d59-9f06-f3de84cf5fd5 for instance a826f525-18be-4776-9042-856d0854971e on hv-cinder-85236 Aug 09 16:54:50.703385 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-cca18c76-ac42-4e6d-8a26-10b580f47778 req-4ed25754-6009-46c2-8680-d61ca54ac6bc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Aug 09 16:54:50.703385 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 237/506] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:54:50.734713 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:50.741366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-32941550-8efd-4678-99e4-1a052c555310 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.158872 Aug 09 16:54:50.741943 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 270/507] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:50 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:50.752533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:50.753885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:50.760190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.763398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.763398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.763398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.763398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.763757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.919343 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:50.922328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:50.922960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:50.927420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-16310fd5-1b64-4f6c-a2cc-588197033d66 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1682 microversion: 2.1 time: 0.179279 Aug 09 16:54:50.928470 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 238/508] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:50 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:50.929228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.929820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.930263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:50.930973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:50.931460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:50.931889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:51.064413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:51.072624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-70741e0d-2bb9-49dc-be79-bf302c11d10c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.154355 Aug 09 16:54:51.073178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 271/509] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:50 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:51.189787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:51.190577 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:51.197326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:51.197812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:51.198307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:51.198993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:51.199466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:51.199885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:51.331220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:51.339607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:51.341109 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:51.342315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3fabe1d8-ad08-4362-944f-d85e72057587 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1721 microversion: 2.20 time: 0.156496 Aug 09 16:54:51.342878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 239/510] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:51 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:51.762419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:51.762960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:51.765366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:51.769952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:51.770428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:51.770857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:51.771573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:51.772102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:51.773428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:51.905565 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:51.913027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a2a16e2d-36b2-45b4-9823-64dcc666f188 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.154411 Aug 09 16:54:51.914369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 272/511] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:51 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:51.950055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:51.950706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:51.957237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:51.957715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:51.958145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:51.958830 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:51.959656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:51.960686 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.093844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:52.094463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:52.096646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:52.101052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.101641 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.101939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.102640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.103120 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.103549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.105082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5742fdd3-47e9-4568-bb93-640626e82a33 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1682 microversion: 2.1 time: 0.158901 Aug 09 16:54:52.105672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 240/512] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:51 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:52.233132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:52.241639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-452ceff3-355f-417f-85cc-9def18a0b071 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1679 microversion: 2.1 time: 0.151034 Aug 09 16:54:52.242246 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 273/513] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:52 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:52.366285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:52.366759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:52.372654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.373139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.373579 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.374270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.374727 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.375173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.505423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:52.514640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:52.516280 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:52.517444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c58648a3-023c-4470-a80a-e01a9fe4eb43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1721 microversion: 2.20 time: 0.155478 Aug 09 16:54:52.518256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 241/514] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:52 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:52.714677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-afb30663-a7ca-404a-8538-11bb80dac5d0 req-fbd1cd39-ee5c-4fa4-9777-45f6dfaba49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "name": "network-vif-unplugged", "status": "completed", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:52.724618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-afb30663-a7ca-404a-8538-11bb80dac5d0 req-fbd1cd39-ee5c-4fa4-9777-45f6dfaba49b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.725094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-afb30663-a7ca-404a-8538-11bb80dac5d0 req-fbd1cd39-ee5c-4fa4-9777-45f6dfaba49b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.725560 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-afb30663-a7ca-404a-8538-11bb80dac5d0 req-fbd1cd39-ee5c-4fa4-9777-45f6dfaba49b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.737723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-afb30663-a7ca-404a-8538-11bb80dac5d0 req-fbd1cd39-ee5c-4fa4-9777-45f6dfaba49b service nova] Creating event network-vif-unplugged:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:54:52.743917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-afb30663-a7ca-404a-8538-11bb80dac5d0 req-fbd1cd39-ee5c-4fa4-9777-45f6dfaba49b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032790 Aug 09 16:54:52.744700 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 274/515] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:52.943313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:52.943313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:52.947280 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.948168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.948714 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:52.951255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:52.951824 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:52.952626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.127974 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:53.129328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:53.137115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.137764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.137979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.138686 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.139230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.139659 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.187690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:53.199006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4a49728a-8b8a-48d8-9fc8-5b622db63fe4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.268975 Aug 09 16:54:53.199650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 242/516] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:52 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:53.264594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:53.264594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:53.275154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.275919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.276356 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.277268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.277889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.278596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.300477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:53.309590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e52f9084-bf08-4f2c-9e4e-30139692c8db tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1682 microversion: 2.1 time: 0.185739 Aug 09 16:54:53.310745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 275/517] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:53 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:53.540783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:53.541363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:53.547312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.547792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.548225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.548918 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.549364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.549788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.556870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:53.565159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b74c78be-99b8-43af-9513-f38ad101aeb5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1656 microversion: 2.1 time: 0.305714 Aug 09 16:54:53.566140 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 243/518] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:53 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1656 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:53.590546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7bde3bd3-57c5-4796-896d-8826a2571cef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:53.596747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7bde3bd3-57c5-4796-896d-8826a2571cef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.597236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7bde3bd3-57c5-4796-896d-8826a2571cef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.597672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7bde3bd3-57c5-4796-896d-8826a2571cef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.624480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7bde3bd3-57c5-4796-896d-8826a2571cef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Going to try to start instance {{(pid=124901) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 16:54:53.716895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:53.724941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:53.726759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:53.728018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-526685ca-bce7-4025-bced-4fb93df409a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1724 microversion: 2.20 time: 0.191567 Aug 09 16:54:53.734335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 276/519] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:53 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:53.750635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c80f995-09fd-42da-a116-3fddde0b67db"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:53.753067 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:53.761886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.762372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.763074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.763587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.764040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.764460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.768319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:53.825169 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7bde3bd3-57c5-4796-896d-8826a2571cef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action" status: 202 len: 0 microversion: 2.1 time: 0.239213 Aug 09 16:54:53.827674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 244/520] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:54:53 2022] POST /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:54:53.836945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:53.838293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:53.847570 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.849390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.850017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:53.850913 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:53.851604 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:53.852184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:54.051638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:54.062010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1fa0c352-4b65-496f-9cfc-d8d12ac3af13 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1665 microversion: 2.1 time: 0.229488 Aug 09 16:54:54.066710 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 245/521] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:53 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1665 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:54.217144 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-fb4560d0-5177-4870-b1bb-41bb42e73fe0 req-6ee57354-eca5-416b-8347-77a03d046284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c13ec5a-b577-4bed-aa8c-ce73b8391b3c", "name": "network-vif-deleted", "tag": "6e84ef22-6ed0-41c2-a430-5a00d8efa76c"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:54.227566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fb4560d0-5177-4870-b1bb-41bb42e73fe0 req-6ee57354-eca5-416b-8347-77a03d046284 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:54.228046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fb4560d0-5177-4870-b1bb-41bb42e73fe0 req-6ee57354-eca5-416b-8347-77a03d046284 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:54.228631 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fb4560d0-5177-4870-b1bb-41bb42e73fe0 req-6ee57354-eca5-416b-8347-77a03d046284 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:54.240247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-fb4560d0-5177-4870-b1bb-41bb42e73fe0 req-6ee57354-eca5-416b-8347-77a03d046284 service nova] Creating event network-vif-deleted:6e84ef22-6ed0-41c2-a430-5a00d8efa76c for instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c on hv-cinder-85236 Aug 09 16:54:54.245847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-fb4560d0-5177-4870-b1bb-41bb42e73fe0 req-6ee57354-eca5-416b-8347-77a03d046284 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039347 Aug 09 16:54:54.246450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 246/522] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:54:54.252443 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:54.253142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:54.262777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:54.263536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:54.264162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:54.265089 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:54.265745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:54.266315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:54.410226 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:54.418267 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6fcb44db-27bb-4bbb-bf9c-9bf5b51d49b3 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.170402 Aug 09 16:54:54.418860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 247/523] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:54 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:54.436583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:54.438017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:54.443732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:54.444514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:54.445134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:54.445907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:54.446316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:54.446744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:54.518979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:54.528858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0e7f835c-c98b-498c-a0e9-717e7e591d9b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1614 microversion: 2.1 time: 0.095934 Aug 09 16:54:54.535284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 248/524] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:54 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:54.862471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f5b83c50-40ce-4003-8b36-46b731d61362 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.115506 Aug 09 16:54:54.863234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 277/525] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Aug 9 16:54:53 2022] POST /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 188 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:54:55.019695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:55.026706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:55.026706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:55.028096 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.028765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.029209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.030086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.030539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.030962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.082415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124901) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 16:54:55.090596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:55.091991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:55.107177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.107844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.108286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.109178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.109797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.110386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.269052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:55.277729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-74033671-d0d1-4530-a19a-9ea56009f0b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1665 microversion: 2.1 time: 0.191151 Aug 09 16:54:55.278318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 278/526] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:55 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:55.428603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a9ae4b39-34ac-49d2-b798-f1b4e15fa033 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/action" status: 202 len: 0 microversion: 2.20 time: 0.415235 Aug 09 16:54:55.429638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 249/527] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 16:54:55 2022] POST /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:54:55.438418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:55.439333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:55.450074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.451564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.451564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.457059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.457691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.458354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.466300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:55.466959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:55.480437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.482841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.482841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.482841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.483274 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.483878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.624029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:55.652849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:55.654361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:55.655585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3047badc-6130-4d73-87af-5ab8b2bc5b02 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1750 microversion: 2.20 time: 0.221452 Aug 09 16:54:55.656468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 279/528] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:55 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1750 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:55.661345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:55.661955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:55.668897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.669542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.696654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.696654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.697837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:55.697963 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.697963 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.698137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b6e15f1a-893c-4af8-ae9c-043253863d2e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1318 microversion: 2.1 time: 0.243108 Aug 09 16:54:55.698137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 250/529] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:55 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:55.708843 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:55.709321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:55.710455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:55.710909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'fault' on Instance uuid 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:54:55.753373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:55.761741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ce475629-dc50-4f69-91b5-b86c70b520df tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 200 len: 1331 microversion: 2.1 time: 0.104179 Aug 09 16:54:55.762311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 280/530] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:55 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:56.301476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:56.302070 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:56.310555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.316126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.316126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.316126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.316126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.316666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.466668 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:56.475305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f138a9e5-e748-4ef9-8295-4c27c9ebe337 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1665 microversion: 2.1 time: 0.178144 Aug 09 16:54:56.481638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 251/531] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:56 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:56.680425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:56.681040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:56.687477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.687952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.688387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.689069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.689510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.689932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.712873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:56.713492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:56.719546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.720038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.720471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.721164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.732515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.732997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.834541 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:56.843871 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:56.845380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:56.846655 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-132687c5-52fc-46d3-ba70-7c996fbdbfb5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1750 microversion: 2.20 time: 0.171408 Aug 09 16:54:56.853748 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 281/532] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:56 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:54:56.853748 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:56.853748 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:56.859132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.859633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.860137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.860985 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.861443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.862049 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.877302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c HTTP/1.1 Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:54:56.878940 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:54:56.880383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '2c13ec5a-b577-4bed-aa8c-ce73b8391b3c'} Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:54:56.881162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:54:56.883657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:54:56.884790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:54:56.884790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4331279a-0b8b-475d-a77f-754c13d48af1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 404 len: 111 microversion: 2.1 time: 0.032151 Aug 09 16:54:56.884790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 282/533] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:56 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:54:56.885019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:56.891443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-93d84fb8-edb4-48e3-9441-666b21be350d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '.version_select at 0x7fccc50033a0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:56.892050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-14d96aca-e03c-4fcf-9813-461f0522af73 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1506 microversion: 2.1 time: 0.183375 Aug 09 16:54:56.892630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 252/534] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:56 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:54:56.913845 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67285c57-1863-4db6-9dcf-49be249d0947", "device": "/dev/sdb"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:56.917173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:56.923324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.923836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.924278 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.924979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:56.925438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:56.925867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:56.930120 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:54:56.978782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-93d84fb8-edb4-48e3-9441-666b21be350d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-290511939" status: 202 len: 0 microversion: 2.1 time: 0.092428 Aug 09 16:54:56.989793 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 283/535] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 16:54:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-290511939 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:54:57.497275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:57.497934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:57.504721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:57.505204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:57.505635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:57.506947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:57.507849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:57.508285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:57.706117 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:57.723014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f6526040-91d9-444a-8a5e-6738d304e07c tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1669 microversion: 2.1 time: 0.229305 Aug 09 16:54:57.727277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 284/536] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:54:57 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1669 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:54:57.826866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6fdc111b-926e-452f-9c10-d8b81995b93e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "POST /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917118 Aug 09 16:54:57.827964 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 253/537] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:54:56 2022] POST /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:54:57.873154 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:57.873853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:57.880977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:57.881912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:57.882538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:57.883466 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:57.883917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:57.884397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:58.021811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-44d3c7c1-e193-40a4-bc4d-65e5fa5ba94c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: .version_select at 0x7fccc4e8b8b0>, body: {"keypair": {"name": "tempest-keypair-204670184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUoBaJYYPCBJ0j5BgbOcoVknTyBcBwmBEYzWnF0LgCN6r5MoQrCHmFzPDx52CnoazyCpynZEVwaOO+Cw2rZpcp+u34RiYYqIHAUcz0ryNfxXuXcgalhoWB7v8xpqbuDkA=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:54:58.054164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-44d3c7c1-e193-40a4-bc4d-65e5fa5ba94c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:54:58.054164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-44d3c7c1-e193-40a4-bc4d-65e5fa5ba94c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:54:58.068930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:58.078795 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:58.080365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:58.081524 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-11c2ac45-56c2-409a-9ac9-e9d199b1049f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1752 microversion: 2.20 time: 0.213318 Aug 09 16:54:58.082082 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 285/538] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:57 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1752 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:54:58.133206 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-44d3c7c1-e193-40a4-bc4d-65e5fa5ba94c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115538 Aug 09 16:54:58.133829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 254/539] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:54:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:54:59.106267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:54:59.107564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:54:59.114432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:59.115344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:59.115468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:59.117104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:54:59.117563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:54:59.117988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:54:59.276936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:59.285331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:59.286823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:54:59.288724 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a8b383e4-9e3c-4a85-b546-84bb3cee2269 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1752 microversion: 2.20 time: 0.186308 Aug 09 16:54:59.289304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 286/540] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:54:59 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:00.316899 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:00.317633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:00.326212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:00.327043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:00.328209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:00.329539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:00.330802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:00.330802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:00.494518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:00.503547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:00.505034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:00.506263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8b1d2a57-f9c7-40c4-8123-4808dc9471cf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1752 microversion: 2.20 time: 0.194392 Aug 09 16:55:00.507045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 255/541] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:00 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:00.564864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1788415572", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d512bb64-4fdf-40f1-b457-d57f69ae1831"}], "security_groups": [{"name": "tempest-securitygroup--1881285628"}], "key_name": "tempest-keypair-204670184", "user_data": "}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:00.672564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] validate_networks() for [('d512bb64-4fdf-40f1-b457-d57f69ae1831', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:55:01.060527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:55:01.060946 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:55:01.061407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:55:01.061950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:55:01.062372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:55:01.071370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:01.072048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:01.072479 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:01.073228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:01.073710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:01.074128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:01.093634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:55:01.097862 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:55:01.110358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:55:01.112688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:55:01.246618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-db12b358-3b4c-4534-82b7-b172babac3f8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685448 Aug 09 16:55:01.247539 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 287/542] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:55:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:55:01.259391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-90750776-69c6-4afa-a298-2d921df0787c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:01.260363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-90750776-69c6-4afa-a298-2d921df0787c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:01.333513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90750776-69c6-4afa-a298-2d921df0787c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:01.341105 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-90750776-69c6-4afa-a298-2d921df0787c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1241 microversion: 2.1 time: 0.086605 Aug 09 16:55:01.341681 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 256/543] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:01 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:01.532998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:01.536924 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:01.540517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:01.541068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:01.541510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:01.542211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:01.542670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:01.543111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:01.667765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:01.670269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:01.677307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:01.677791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:01.678845 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:01.679805 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:01.680269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:01.680695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:01.696879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:01.705509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:01.707012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:01.708259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9fdbc49c-436a-41fe-b088-d314c313150e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1752 microversion: 2.20 time: 0.179664 Aug 09 16:55:01.708851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 288/544] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:01 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:01.713935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'flavor' on Instance uuid 53f72561-f391-43d4-8264-28016993a6a5 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:55:02.082182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d5b96ae2-92b5-45f6-90c8-dd59260eecfc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/action" status: 200 len: 32 microversion: 2.1 time: 0.419160 Aug 09 16:55:02.083200 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 257/545] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:55:01 2022] POST /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 16:55:02.093196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:02.093820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:02.102736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:02.103668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:02.104192 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:02.105273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:02.105753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:02.106174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:02.253908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:02.263332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6da37203-4480-4203-8d4b-3bf6197e9826 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.174184 Aug 09 16:55:02.263977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 289/546] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:02 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:02.364056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:02.364774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:02.371823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:02.375275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:02.375275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:02.375275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:02.375275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:02.375798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:02.471092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:02.479126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3fadc222-c1c7-41d3-91ef-c4cd43ac5136 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1245 microversion: 2.1 time: 0.120085 Aug 09 16:55:02.479733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 258/547] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:02 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:02.741953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:02.747586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:02.760072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:02.761624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:02.762234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:02.763090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:02.764281 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:02.764804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:02.912567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:02.921833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:02.923364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:02.924522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-58e18043-bc0e-4377-9488-652f40d0728e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1752 microversion: 2.20 time: 0.188503 Aug 09 16:55:02.925072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 290/548] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:02 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1752 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:03.283810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:03.284507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:03.290938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:03.291450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:03.291887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:03.292574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:03.293023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:03.293509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:03.429961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:03.438133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4e8bdc06-b3c5-4327-b251-e6abe4f69e6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.158060 Aug 09 16:55:03.438645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 259/549] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:03 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:03.500664 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:03.501284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:03.507864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:03.508351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:03.508787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:03.509519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:03.510019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:03.510443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:03.574149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:03.581634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dfeb7dd7-2f4d-47a6-95e6-0acaba7d2cb6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1293 microversion: 2.1 time: 0.084815 Aug 09 16:55:03.582195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 291/550] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:03 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:03.949297 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:03.950215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:03.956376 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:03.956863 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:03.957301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:03.958000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:03.958463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:03.958894 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:04.424263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:04.432960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:04.434467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:04.435665 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-803d35df-cf1a-4e81-a4c3-3b8d6b820e21 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.490301 Aug 09 16:55:04.436259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 260/551] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:03 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:04.463622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:04.464926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:04.476484 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:04.477570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:04.478407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:04.479723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:04.480549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:04.482155 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:04.604413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:04.605028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:04.610986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:04.611498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:04.611928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:04.612614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:04.613060 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:04.613480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:04.632597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:04.640761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-10e34107-a988-460c-90bd-a77ac611f3e0 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.184788 Aug 09 16:55:04.641351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 292/552] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:04 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:04.691378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:04.698342 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-82a42434-1753-4f31-9492-8b32eb744591 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1299 microversion: 2.1 time: 0.098813 Aug 09 16:55:04.698922 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 261/553] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:04 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:05.470955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:05.471604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:05.479379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:05.479967 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:05.480592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:05.481433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:05.481912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:05.482486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:05.486696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:05.642158 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:05.654996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:05.655726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:05.658130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0b720610-1c04-4304-b9d6-a055f1e189a5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.200996 Aug 09 16:55:05.659186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 293/554] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:05 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:05.662137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:05.662811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:05.670136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:05.670694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:05.685074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:05.686837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:05.688255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:05.689815 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:05.720881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:05.721932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:05.746379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:05.747605 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:05.748335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:05.750041 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:05.751225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:05.752251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:05.963878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:05.980583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1df27ffa-0b7e-4308-a1fb-be7fe8d5927c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.265077 Aug 09 16:55:05.982115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 294/555] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:05 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:06.066977 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:06.076348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0331d0a0-d1c1-497a-aef8-b19de0c0c71b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.417952 Aug 09 16:55:06.077594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 262/556] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:05 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:06.683936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:06.684557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:06.691735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:06.692460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:06.693071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:06.694597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:06.695308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:06.695918 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:06.799215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-959b4335-7cc0-45e8-b798-a10a40449d88 req-21704200-01c0-4626-91e6-e4e68331ba5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead4e2e4-484b-4150-81ce-4cfc1e9a1c06", "tag": "787d32ec-b8e9-4f96-acec-6fb00d0163dd"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:06.811585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-959b4335-7cc0-45e8-b798-a10a40449d88 req-21704200-01c0-4626-91e6-e4e68331ba5b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:06.812405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-959b4335-7cc0-45e8-b798-a10a40449d88 req-21704200-01c0-4626-91e6-e4e68331ba5b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:06.813348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-959b4335-7cc0-45e8-b798-a10a40449d88 req-21704200-01c0-4626-91e6-e4e68331ba5b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:06.836710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:06.842155 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-959b4335-7cc0-45e8-b798-a10a40449d88 req-21704200-01c0-4626-91e6-e4e68331ba5b service nova] Creating event network-changed:787d32ec-b8e9-4f96-acec-6fb00d0163dd for instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 on hv-cinder-85236 Aug 09 16:55:06.851211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-959b4335-7cc0-45e8-b798-a10a40449d88 req-21704200-01c0-4626-91e6-e4e68331ba5b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055433 Aug 09 16:55:06.852406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 263/557] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:55:06.864833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:06.880815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:06.880815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-05403cb5-a79e-484f-a065-f070381c7652 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.188807 Aug 09 16:55:06.880815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 295/558] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:06 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:07.004860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:07.005944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:07.013512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:07.014095 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:07.014662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:07.015430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:07.019233 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:07.019233 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:07.103275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:07.103897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:07.110610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:07.111388 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:07.112025 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:07.112955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:07.113587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:07.123598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:07.232322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:07.248785 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cdeb4001-6c57-4d39-8cff-78b28178fd09 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.247983 Aug 09 16:55:07.267194 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 264/559] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:06 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:07.338583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:07.350113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-80e7f1e3-bed3-40a1-9b38-035cefb628b1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.251573 Aug 09 16:55:07.351674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 296/560] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:07 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:07.894233 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:07.895581 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:07.903674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:07.904491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:07.905227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:07.906323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:07.906918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:07.907504 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:08.044021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:08.057423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:08.059388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:08.060879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-44414f2a-7e92-46e7-9c4c-3688fdd06df3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.170613 Aug 09 16:55:08.062764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 265/561] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:07 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:08.279397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:08.281173 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:08.292477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:08.292970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:08.293409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:08.294115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:08.294607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:08.294986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:08.379567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:08.380762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:08.388319 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:08.388870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:08.389570 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:08.390623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:08.391209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:08.391829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:08.484774 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:08.485906 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7a22135d-6e17-4d0f-8cbc-c386c316a0ef tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.212063 Aug 09 16:55:08.486886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 297/562] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:08 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:08.587256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:08.597363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-58749088-8dcb-4380-9274-39a6dec10d51 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.221557 Aug 09 16:55:08.611521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 266/563] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:08 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:09.172609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:09.173153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:09.180383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:09.180868 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:09.181299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:09.182004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:09.182499 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:09.182932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:09.326858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:09.337847 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:09.339511 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:09.340647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2581c577-8603-4ba5-873e-85f919d8ef00 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.172171 Aug 09 16:55:09.341560 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 298/564] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:09 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:09.508962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:09.509582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:09.516298 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:09.516864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:09.517495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:09.518273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:09.518841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:09.519311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:09.620594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:09.625509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:09.633822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:09.634515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:09.635257 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:09.636174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:09.636808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:09.637426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:09.703774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:09.713715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-dfaea25d-1649-453e-b8e7-3bba0501bb1b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.209071 Aug 09 16:55:09.718765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 267/565] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:09 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:09.793391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:09.801611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fa551698-a00e-4594-8156-8c3e254b9892 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.187418 Aug 09 16:55:09.802191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 299/566] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:09 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:10.363762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:10.364294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:10.370369 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:10.370888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:10.371318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:10.372017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:10.372463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:10.372880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:10.510065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:10.519924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:10.522791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:10.524329 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-02e242bb-803d-4427-8249-3ff729637577 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.164534 Aug 09 16:55:10.525065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 268/567] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:10 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:10.738364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:10.739209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:10.746729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:10.747336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:10.747845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:10.748626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:10.749152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:10.749673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:10.833794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:10.835284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:10.841462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:10.841956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:10.842401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:10.843122 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:10.843587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:10.844016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:10.848346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:10.889769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:10.897903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dab7d6b9-3c3a-42b7-9767-cf59c8cda90a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.163552 Aug 09 16:55:10.898498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 300/568] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:10 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:10.994300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:11.002863 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0c1fd6e0-d812-4001-9bef-186f78d40285 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.183466 Aug 09 16:55:11.003595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 269/569] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:10 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:11.549122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:11.549745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:11.551589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:11.552252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=6 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:11.557835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:11.560291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:11.560291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:11.560291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:11.560291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:11.560722 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:11.701383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:11.710861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:11.712488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:11.713644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-585757a5-c4c3-4c7e-adf2-7a78682dc69d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.168570 Aug 09 16:55:11.714201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 301/570] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:11 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:11.926143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:11.926725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:11.929147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=6 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:11.934154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:11.934790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:11.935255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:11.941220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:11.941220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:11.941220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:12.025120 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:12.025909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:12.035002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:12.035549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:12.036000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:12.036712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:12.037211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:12.038026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:12.089019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:12.103630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b6086920-9664-46f5-8e54-ed2474d1daf0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.181454 Aug 09 16:55:12.104225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 270/571] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:11 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:12.394209 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:12.402651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e2363a7b-c8fc-4237-812b-cef7e1e10bac tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.382205 Aug 09 16:55:12.407201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 302/572] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:12 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:12.737539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:12.738529 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:12.745168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:12.745769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:12.746305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:12.747053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:12.747619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:12.748118 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:12.889054 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:12.898709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:12.900451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:12.901752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-db69d5a2-0429-4273-a46b-99ef14520cf7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.168218 Aug 09 16:55:12.902454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 271/573] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:12 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:13.124627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:13.125250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:13.131986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:13.132237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:13.132673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:13.133370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:13.133826 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:13.134254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:13.267071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:13.275661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-836d7594-05ac-40fb-b7f5-2efa12aa2966 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.154857 Aug 09 16:55:13.276238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 303/574] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:13 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:13.429179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:13.429896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:13.436463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:13.436946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:13.437381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:13.438070 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:13.438523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:13.438947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:13.590178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:13.598151 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b7b92741-8e29-46cb-80a8-3472c4b2c2ab tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.173518 Aug 09 16:55:13.598722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 272/575] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:13 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:13.927542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:13.928642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:13.937040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:13.937611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:13.938315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:13.939187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:13.939759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:13.940293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:14.103806 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:14.112886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:14.114481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:14.116978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-19e89a90-2db7-4cb9-9ca9-b93851b705b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.194550 Aug 09 16:55:14.117992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 304/576] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:13 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:14.298250 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:14.298918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:14.305734 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:14.306208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:14.306638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:14.307461 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:14.307911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:14.308328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:14.450763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:14.462291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8093d8ac-cd30-4002-939f-e91cb58d0c05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.167774 Aug 09 16:55:14.463581 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 273/577] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:14 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:14.620349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:14.620949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:14.627241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:14.627716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:14.628147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:14.629028 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:14.629485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:14.629959 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:14.767417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:14.776732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-609723a7-11f1-420c-8de8-428cf7cf5610 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.161001 Aug 09 16:55:14.777312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 305/578] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:14 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:15.140430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:15.141033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:15.146893 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:15.147937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:15.148368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:15.149051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:15.149522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:15.150007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:15.283499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:15.293101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:15.294112 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:15.295310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a1b64f94-866c-429d-a396-1cad1d480ec1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.158805 Aug 09 16:55:15.295873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 274/579] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:15 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:15.482937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:15.483547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:15.489413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:15.489888 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:15.490328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:15.491261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:15.491820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:15.492247 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:15.623418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:15.631596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ac6c3eb4-5981-45d1-a007-37da2adc2121 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.152429 Aug 09 16:55:15.632432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 306/580] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:15 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:15.798806 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:15.799427 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:15.805747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:15.806222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:15.806657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:15.807378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:15.807831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:15.808255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:15.953035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:15.961973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-76edcd75-f028-4a34-bfd0-82c1efc37c11 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.167026 Aug 09 16:55:15.962650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 275/581] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:15 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:16.319552 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:16.320101 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:16.326093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:16.326581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:16.327017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:16.327750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:16.328202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:16.328671 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:16.463751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:16.472551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:16.474082 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:16.475931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2c9472f6-7f13-43d6-82b2-26144b87d2ee tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.160039 Aug 09 16:55:16.476708 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 307/582] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:16 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:16.652668 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:16.653276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:16.659097 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:16.659599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:16.660025 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:16.660700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:16.661143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:16.661556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:16.796356 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:16.805541 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-81a89458-e549-4520-aa8b-30c5c7dcca25 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.156324 Aug 09 16:55:16.806161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 276/583] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:16 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:16.983165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:16.983694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:16.990072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:16.990556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:16.991392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:16.992192 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:16.992647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:16.993075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:17.125974 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:17.134186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cdaa560d-09a8-481c-adce-f4b24e30e9d1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.154949 Aug 09 16:55:17.134768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 308/584] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:16 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:17.500250 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:17.504616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:17.507709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:17.508200 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:17.508636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:17.509478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:17.509937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:17.510367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:17.648623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:17.657176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:17.658707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:17.659905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b722b340-069c-4415-a437-3a4d53f23722 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.163553 Aug 09 16:55:17.660685 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 277/585] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:17 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:55:17.826350 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:17.826967 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:17.833066 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:17.833546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:17.833978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:17.834703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:17.835190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:17.835622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:17.978757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:17.985298 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:17.987401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-76c44cfc-7542-4036-b59b-4f00e591a73a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.164877 Aug 09 16:55:17.988008 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 309/586] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:17 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:18.155521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:18.156129 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:18.162425 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:18.163430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:18.164331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:18.165017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:18.165487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:18.165892 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:18.295276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:18.303050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a6ccacd7-64ec-43e8-93db-f0ebd93a0a1a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.151353 Aug 09 16:55:18.304361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 278/587] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:18 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:18.684170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:18.685017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:18.691052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:18.691820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:18.692253 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:18.692947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:18.693394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:18.693819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:18.821588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:18.829975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:18.831516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:18.832676 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ffc19cf7-64df-4acc-b981-18e2585ef296 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.153960 Aug 09 16:55:18.833246 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 310/588] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:18 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:19.008986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:19.014458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:19.015507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:19.016002 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:19.016445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:19.017146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:19.017608 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:19.018043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:19.247730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:19.254138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bc68ee6d-3c8a-4da8-ae6c-7d678089d976 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.249183 Aug 09 16:55:19.264521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 279/589] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:19 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:19.325450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:19.326104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:19.333620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:19.333620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:19.333620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:19.334005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:19.334461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:19.335628 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:19.473698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:19.482437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-45a3d7d0-48d6-43d4-b97e-13e9a5723e50 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.161102 Aug 09 16:55:19.483185 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 311/590] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:19 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:19.856438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:19.857086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:19.863009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:19.863599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:19.864037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:19.864729 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:19.865186 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:19.865616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:19.995975 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:20.004449 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:20.005946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:20.007260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5d3f5789-ee2c-47b5-bb02-ec77580ffbd4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.155358 Aug 09 16:55:20.017384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 280/591] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:19 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:20.276580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:20.277197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:20.279519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:20.284110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:20.284592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:20.285034 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:20.285732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:20.286197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:20.286625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:20.421438 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:20.429205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-05a0a1e2-0340-4574-9835-b0cf40a0b77b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.156723 Aug 09 16:55:20.429843 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 312/592] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:20 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:20.503378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:20.504000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:20.510920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:20.511436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:20.511907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:20.512609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:20.513062 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:20.513493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:20.644829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:20.657626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3bb9ebf4-d00c-44f5-9b13-9fff0892e593 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.154397 Aug 09 16:55:20.657626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 281/593] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:20 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:21.031739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:21.032495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:21.039605 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:21.044743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:21.044743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:21.044743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:21.044743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:21.045114 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:21.173553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:21.182830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:21.184352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:21.185502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1d4d62c3-4ba4-4f42-8a7e-bbd1f1732707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.157782 Aug 09 16:55:21.186067 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 313/594] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:21 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:21.450475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:21.451129 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:21.457163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:21.457642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:21.458071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:21.458758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:21.459254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:21.459650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:21.593511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:21.601787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e99e2cd6-28be-41de-86ab-595bb9e8002d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.155141 Aug 09 16:55:21.602357 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 282/595] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:21 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:21.676640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:21.677228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:21.684473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:21.684964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:21.685399 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:21.686225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:21.686832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:21.687299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:21.815969 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:21.825316 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0c329bc7-9290-483e-957c-a8ff9b323cc5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.152233 Aug 09 16:55:21.825899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 314/596] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:21 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:22.208074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:22.208690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:22.214818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:22.215341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:22.215771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:22.216498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:22.216951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:22.217377 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:22.346095 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:22.355058 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:22.356577 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:22.357735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-19f57880-8e1d-4ba5-ab1f-17d2a37c4f53 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.153710 Aug 09 16:55:22.358302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 283/597] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:22 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:22.623596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:22.624228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:22.630050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:22.630525 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:22.630972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:22.631669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:22.632680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:22.633118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:22.763674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:22.771086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7effd0ca-57d0-48a9-b053-11aa0c836416 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.151380 Aug 09 16:55:22.771707 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 315/598] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:22 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:22.846823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:22.847459 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:22.855328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:22.855803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:22.856231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:22.856913 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:22.857360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:22.857779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:22.989926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:22.998857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a95bdbf8-0e80-4c35-89ed-167ea125eb4e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.155730 Aug 09 16:55:22.999462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 284/599] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:22 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:23.381178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:23.381818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:23.388842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:23.389319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:23.389765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:23.390433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:23.390876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:23.391335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:23.527415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:23.535496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:23.536990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:23.538172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f82ca2c3-2bc1-4720-8aa1-b2a4fb887998 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.160833 Aug 09 16:55:23.538746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 316/600] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:23 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:23.790754 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:23.791383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:23.797250 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:23.797723 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:23.798150 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:23.798828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:23.799315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:23.799734 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:23.926414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:23.931248 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:23.935475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-961306ba-d51d-42cb-809d-60d5acd8373c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.148549 Aug 09 16:55:23.936053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 285/601] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:23 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:24.020342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:24.021059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:24.028226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:24.028808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:24.029259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:24.029963 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:24.030425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:24.030854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:24.161133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:24.170023 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-522c019e-4895-4ff7-96fd-6d71bc5b2b93 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.153625 Aug 09 16:55:24.170598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 317/602] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:24 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:24.561112 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:24.561749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:24.568276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:24.568757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:24.569189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:24.569875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:24.570408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:24.570830 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:24.706539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:24.715977 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:24.717438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:24.718629 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e2107643-1032-42af-883c-8b7ba1120fdf tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.161439 Aug 09 16:55:24.719215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 286/603] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:24 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:55:24.956316 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:24.956932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:24.964277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:24.967627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:24.967627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:24.967627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:24.967627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:24.968030 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:25.110185 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:25.118763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e954dbad-6322-4f23-9f00-963a38663d8b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.166549 Aug 09 16:55:25.119457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 318/604] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:24 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:25.192262 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:25.192931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:25.199593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:25.200065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:25.206293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:25.206293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:25.206293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:25.206293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:25.334243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:25.343180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8d07d9fd-853c-4515-9a76-a52a3337dc6a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.155107 Aug 09 16:55:25.345543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 287/605] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:25 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:25.742673 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:25.743478 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:25.749580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:25.751798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:25.751798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:25.751798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:25.751798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:25.752235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:25.806690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-e790d636-4ad6-404a-a4d0-c333d057acab req-c6636e2e-1094-4547-a594-4da5636bff42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4e2e4-484b-4150-81ce-4cfc1e9a1c06", "name": "network-vif-plugged", "status": "completed", "tag": "787d32ec-b8e9-4f96-acec-6fb00d0163dd"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:25.813621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:25.817817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-e790d636-4ad6-404a-a4d0-c333d057acab req-c6636e2e-1094-4547-a594-4da5636bff42 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:25.818289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-e790d636-4ad6-404a-a4d0-c333d057acab req-c6636e2e-1094-4547-a594-4da5636bff42 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:25.818711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-e790d636-4ad6-404a-a4d0-c333d057acab req-c6636e2e-1094-4547-a594-4da5636bff42 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:25.830020 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-e790d636-4ad6-404a-a4d0-c333d057acab req-c6636e2e-1094-4547-a594-4da5636bff42 service nova] Creating event network-vif-plugged:787d32ec-b8e9-4f96-acec-6fb00d0163dd for instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 on hv-cinder-85236 Aug 09 16:55:25.835133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-e790d636-4ad6-404a-a4d0-c333d057acab req-c6636e2e-1094-4547-a594-4da5636bff42 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 Aug 09 16:55:25.836261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 288/606] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:55:25.886406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:25.894749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:25.896292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:25.897449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-650f0ba2-c708-462e-98df-38eef7433b82 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.159527 Aug 09 16:55:25.899591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 319/607] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:25 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:26.140297 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:26.141028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:26.147583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:26.148617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:26.149133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:26.149858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:26.150336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:26.150766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:26.332479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:26.340462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9c054a6a-2816-4c1a-89cf-e4b10894c21f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.204510 Aug 09 16:55:26.341047 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 289/608] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:26 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:26.365127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:26.365735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:26.372318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:26.372794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:26.373227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:26.373909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:26.374358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:26.374780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:26.503491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:26.512056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b19b895a-8cc3-4cde-99b0-4c23439cc83e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.150820 Aug 09 16:55:26.512635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 320/609] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:26 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:26.921836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:26.922456 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:26.928476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:26.928958 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:26.929391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:26.930076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:26.930529 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:26.931880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:27.064911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:27.073512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:27.074990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:27.076187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e63237ab-8c2a-4191-93be-4f0fa6021e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.158303 Aug 09 16:55:27.076744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 290/610] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:26 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:27.360224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:27.360839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:27.366698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:27.367278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:27.367635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:27.368900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:27.369375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:27.369899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:27.502979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:27.511201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fa66c007-a3f8-4ae5-b0a6-7d6d15b26372 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.154798 Aug 09 16:55:27.511773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 321/611] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:27 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:27.534049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:27.534654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:27.543294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:27.543781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:27.544214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:27.544904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:27.545359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:27.545781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:27.674830 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:27.683849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-29d2a302-9ddc-4b1c-a6e0-0e9056ea3141 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.154052 Aug 09 16:55:27.684419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 291/612] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:27 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:28.100122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:28.100759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:28.107815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:28.108286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:28.108712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:28.109396 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:28.109842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:28.110261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:28.238684 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:28.247064 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:28.248707 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:28.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3a5c391d-ce82-4126-803b-1a405516a85e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.153972 Aug 09 16:55:28.250468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 322/613] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:28 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:28.536495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:28.536495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:28.538664 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:28.539090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:28.539588 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:28.541317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:28.542334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:28.543199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:28.682145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:28.690033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-793d3a32-11b1-4ab2-8350-74ef0ea3a97d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.162672 Aug 09 16:55:28.690605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 292/614] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:28 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:28.705445 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:28.706134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:28.713231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:28.713864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:28.714311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:28.715086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:28.715558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:28.715991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:28.905854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:28.914060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-76d6d814-56a7-493b-8353-7383a0a27224 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.212721 Aug 09 16:55:28.914648 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 323/615] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:28 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:29.272882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:29.273502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:29.292110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:29.292624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:29.293072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:29.293812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:29.294271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:29.294758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:29.501426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:29.510114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:29.512049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:29.513202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-af22cd69-4a41-4fc8-95eb-32a1c70f7f1b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.244320 Aug 09 16:55:29.514029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 293/616] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:29 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:29.712216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:29.713449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:29.720020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:29.720506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:29.720944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:29.721644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:29.722097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:29.722528 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:29.859784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:29.867310 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b090a53e-16c7-46d0-8b9b-0dc4153a2fe2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.159365 Aug 09 16:55:29.867903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 324/617] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:29 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:29.936309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:29.936931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:29.943522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:29.944011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:29.944628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:29.945332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:29.945865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:29.946294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:30.078346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:30.086467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-94b25d2b-e3cd-4d63-9374-fc98e9a60fa6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1734 microversion: 2.1 time: 0.154142 Aug 09 16:55:30.087030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 294/618] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:29 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:30.539736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:30.540493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:30.548695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:30.549576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:30.550330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:30.551646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:30.555818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:30.555818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:30.727957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:30.737061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:30.738597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:30.739962 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2a1d7b4f-d1c9-4eaa-b846-73e41b2634fd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.204121 Aug 09 16:55:30.740567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 325/619] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:30 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:30.750721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-df078e96-9b3f-4dca-beb0-d65a6b703023 req-a7d3a7bf-6e4f-4427-8414-0ebed81d0e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "name": "network-vif-plugged", "status": "completed", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:30.761035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-df078e96-9b3f-4dca-beb0-d65a6b703023 req-a7d3a7bf-6e4f-4427-8414-0ebed81d0e88 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:30.761676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-df078e96-9b3f-4dca-beb0-d65a6b703023 req-a7d3a7bf-6e4f-4427-8414-0ebed81d0e88 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:30.762174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-df078e96-9b3f-4dca-beb0-d65a6b703023 req-a7d3a7bf-6e4f-4427-8414-0ebed81d0e88 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:30.773142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-df078e96-9b3f-4dca-beb0-d65a6b703023 req-a7d3a7bf-6e4f-4427-8414-0ebed81d0e88 service nova] Creating event network-vif-plugged:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:55:30.778771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-df078e96-9b3f-4dca-beb0-d65a6b703023 req-a7d3a7bf-6e4f-4427-8414-0ebed81d0e88 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031722 Aug 09 16:55:30.779523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 295/620] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:30.888779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:30.889455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:30.895661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:30.896138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:30.896569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:30.897344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:30.897908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:30.898331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:30.920044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:31.036129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:31.044223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a1cafdfd-e713-43b0-9920-60a3fb086e18 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.160055 Aug 09 16:55:31.044784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 326/621] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:30 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:31.108692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:31.109404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:31.115628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.116112 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.116545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.117352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.117779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.118205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.253430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:31.262034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-88dd20e6-8d9e-4b60-b6bd-76f9e32c9aaf tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1714 microversion: 2.1 time: 0.158117 Aug 09 16:55:31.262613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 296/622] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:31 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:31.323338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:31.323840 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:31.330131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.330620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.331061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.331784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.332265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.332693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.417493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] HTTP exception thrown: Cannot 'detach_volume' instance 53f72561-f391-43d4-8264-28016993a6a5 while it is in vm_state rescued Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Request method failure captured: Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments/cae8add1-f3cb-4ce8-a1ae-685db9c45c76 HTTP/1.1 Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBhL9d8qboR3QkFRwU49x9sFiLeAQIxSrdali_ha4_JPziN37oRsK0P3Dbu5Z-fUJm39DaHNnsc1cckSTFHvgqIJssbnKvrPv1ymyhFgGBMRNYummTkBkuYAq97vQ3hHctrBf0WnT_zV9XnubQ6dznK9ZyF3FEMmFbE23nXq14kuyc Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:55:31.419165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b681b90f2f074e8c8cfb11939edc7f72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}] Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: c4529e57de654b36b53662be0148834c Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:55:31.420622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Cannot 'detach_volume' instance 53f72561-f391-43d4-8264-28016993a6a5 while it is in vm_state rescued Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'server_id': '53f72561-f391-43d4-8264-28016993a6a5', 'id': 'cae8add1-f3cb-4ce8-a1ae-685db9c45c76'} Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53f72561-f391-43d4-8264-28016993a6a5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:55:31.421426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 53f72561-f391-43d4-8264-28016993a6a5 while it is in vm_state rescued Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 53f72561-f391-43d4-8264-28016993a6a5 while it is in vm_state rescued Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:55:31.422653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Returning 409 to user: Cannot 'detach_volume' instance 53f72561-f391-43d4-8264-28016993a6a5 while it is in vm_state rescued {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:55:31.423719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-aafbeb8f-6d40-441e-b40d-28bc461afa27 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments/cae8add1-f3cb-4ce8-a1ae-685db9c45c76" status: 409 len: 152 microversion: 2.1 time: 0.102613 Aug 09 16:55:31.423719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 327/623] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:55:31 2022] DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments/cae8add1-f3cb-4ce8-a1ae-685db9c45c76 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 16:55:31.430829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:31.431510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:31.437728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.438215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.438835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.439457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.439917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.440344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.686489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-72e12394-852e-481b-9590-94c145f76cea tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "POST /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/action" status: 202 len: 0 microversion: 2.1 time: 0.259347 Aug 09 16:55:31.687126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 297/624] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:55:31 2022] POST /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:55:31.695635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:31.696340 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:31.703716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.704338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.704912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.705693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.706271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.706814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.763209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:31.764231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:31.770524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.771180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.771480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.777145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:31.777145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:31.777145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:31.852770 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:31.863745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5eda5be9-aa88-4099-8e1a-319446dcfcf6 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.172310 Aug 09 16:55:31.864476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 328/625] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:31 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:31.914408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:31.923694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:31.925197 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:31.926431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-298a7027-a2cd-4df0-a337-146d9b491b3d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.167495 Aug 09 16:55:31.926989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 298/626] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:31 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:32.066144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:32.067038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:32.074128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:32.074617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:32.075047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:32.075752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:32.076198 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:32.076698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:32.218026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:32.225408 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dad203fd-2898-4065-88c4-fa2692cbfd47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1367 microversion: 2.1 time: 0.163477 Aug 09 16:55:32.226180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 329/627] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:32 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:32.884130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:32.884832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:32.891352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:32.891835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:32.892305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:32.892994 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:32.893450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:32.893875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:32.929597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:32.930157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:32.937169 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:32.937660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:32.938099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:32.938805 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:32.939329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:32.939838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.026510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lazy-loading 'services' on Instance uuid a826f525-18be-4776-9042-856d0854971e {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:55:33.033930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:33.042726 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0904ed60-70f8-4ac5-88c5-431b26b79904 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.162451 Aug 09 16:55:33.043334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 299/628] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:32 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:33.049753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:33.050447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:33.057828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:33.058319 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:33.058757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.059492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:33.059954 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:33.060378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.191010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:33.200663 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:33.202133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:33.203316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-98742042-b6b7-42f8-b686-1bf75ae098ba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.159044 Aug 09 16:55:33.209290 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 300/629] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:33 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:33.211780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-90234072-b9a1-4da8-9abe-909939f4bec0 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e/os-volume_attachments/67285c57-1863-4db6-9dcf-49be249d0947" status: 202 len: 0 microversion: 2.1 time: 0.286070 Aug 09 16:55:33.212372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 330/630] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:55:32 2022] DELETE /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e/os-volume_attachments/67285c57-1863-4db6-9dcf-49be249d0947 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:55:33.247231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:33.247851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:33.253621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:33.254100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:33.254520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.255265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:33.255713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:33.256125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.412204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:33.419766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-65778a81-3593-4ebd-a101-48ad6ec97a90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1556 microversion: 2.1 time: 0.177508 Aug 09 16:55:33.420340 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 301/631] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:33 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:33.443583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:33.444687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:33.454542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:33.455520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:33.456191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.457780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:33.458718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:33.459318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:33.551498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-46b1ccc0-945e-4653-9db0-15eb08ff58f1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114289 Aug 09 16:55:33.552131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 331/632] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:55:33 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:34.064203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:34.064822 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:34.071673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:34.072809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:34.073240 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:34.073926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:34.074379 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:34.074801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:34.207672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:34.211306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:34.216229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d0beeca9-4fac-40ca-8068-8203694b9e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.155912 Aug 09 16:55:34.216819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 302/633] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:34 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:34.226887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:34.227876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:34.234118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:34.234609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:34.235052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:34.235782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:34.236241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:34.236672 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:34.446294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:34.454908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:34.456417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:34.457607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-70f2523b-cf83-4c5e-a219-b58a1a017c91 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.235029 Aug 09 16:55:34.458176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 332/634] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:34 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:34.707148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-5dea3574-d6a9-4955-b667-2de3cc5b71df req-f99af5dc-3a4c-4f22-881a-0fa4b700d7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead4e2e4-484b-4150-81ce-4cfc1e9a1c06", "tag": "787d32ec-b8e9-4f96-acec-6fb00d0163dd"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:34.717580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-5dea3574-d6a9-4955-b667-2de3cc5b71df req-f99af5dc-3a4c-4f22-881a-0fa4b700d7e8 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:34.718066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-5dea3574-d6a9-4955-b667-2de3cc5b71df req-f99af5dc-3a4c-4f22-881a-0fa4b700d7e8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:34.718499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-5dea3574-d6a9-4955-b667-2de3cc5b71df req-f99af5dc-3a4c-4f22-881a-0fa4b700d7e8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:34.731941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-5dea3574-d6a9-4955-b667-2de3cc5b71df req-f99af5dc-3a4c-4f22-881a-0fa4b700d7e8 service nova] Creating event network-changed:787d32ec-b8e9-4f96-acec-6fb00d0163dd for instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 on hv-cinder-85236 Aug 09 16:55:34.737621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-5dea3574-d6a9-4955-b667-2de3cc5b71df req-f99af5dc-3a4c-4f22-881a-0fa4b700d7e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034499 Aug 09 16:55:34.739383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 303/635] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:35.238382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:35.239002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:35.247755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:35.248544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:35.249211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:35.250397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:35.251071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:35.251953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:35.411803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:35.422322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-69b2a948-886c-4940-8814-a447a8e0e474 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.187828 Aug 09 16:55:35.422913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 333/636] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:35 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:35.484011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:35.484807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:35.492657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:35.493242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:35.494480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:35.495380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:35.496057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:35.496541 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:35.665287 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:35.672510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:35.674203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:35.676561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-246a8992-6b99-49b8-be25-6a3ac4cb820c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.197880 Aug 09 16:55:35.689984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 304/637] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:35 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:36.446696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:36.447885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:36.457706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.464670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.464670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.464670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.464670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.465050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.512975 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:36.512975 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:36.524806 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.525704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.526147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.527247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.527867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.528820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.562669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:55:36.654229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:36.662771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-15292cdf-47dd-4165-b4c7-b74288bfa9dc tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.222125 Aug 09 16:55:36.663372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 334/638] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:36 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:36.700039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:36.700909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:36.707333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.708079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.708677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.709564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.710195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.710768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.882874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:36.889841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-723b81d0-a03d-4160-a2c6-7ef98b87dff4 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 204 len: 0 microversion: 2.1 time: 0.382525 Aug 09 16:55:36.890436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 305/639] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:55:36 2022] DELETE /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 16:55:36.892611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:36.894632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:36.895972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1e27c361-cc5b-4123-afff-145112e87e85 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1808 microversion: 2.20 time: 0.200520 Aug 09 16:55:36.896529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 335/640] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:36 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:55:36.900630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:36.901419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:36.907864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.908605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.909107 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:36.909895 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:36.910458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:36.910950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:37.047337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:37.054862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3913fd4b-3c71-4541-927b-b5f89d0df21f tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1512 microversion: 2.1 time: 0.159111 Aug 09 16:55:37.055537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 306/641] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:36 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:37.686563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:37.687268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:37.693899 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:37.694386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:37.694825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:37.695547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:37.696007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:37.696439 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:37.827588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:37.835559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8e421572-1062-4d41-b8ae-5b6fe8093c61 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.152904 Aug 09 16:55:37.836130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 336/642] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:37 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:37.919766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:37.920384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:37.926850 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:37.927378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:37.927820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:37.928538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:37.928995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:37.929419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:38.058099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:38.066889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:38.068476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:38.069651 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-23b19535-2d6a-4874-81f8-351a13895725 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1795 microversion: 2.20 time: 0.154774 Aug 09 16:55:38.070211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 307/643] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:55:37 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:55:38.077258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:38.077872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:38.083761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:38.084238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:38.084670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:38.085351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:38.085798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:38.086218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:38.213901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:38.221302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a5c992e2-00eb-4bdc-b51e-f5ae813a90cc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1512 microversion: 2.1 time: 0.148891 Aug 09 16:55:38.221869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 337/644] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:38 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:38.858312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:38.858844 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:38.864778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:38.865256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:38.865686 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:38.866367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:38.866826 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:38.867294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:39.001491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:39.010975 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-91471365-bf50-44e4-b33a-d9263f8e8e75 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.156548 Aug 09 16:55:39.015199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 308/645] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:38 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:55:39.242981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:39.244620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:39.252664 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:39.253159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:39.253598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:39.254368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:39.254832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:39.255292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:39.402184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:39.409990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cc983dc6-3515-483e-99bc-6340873a1797 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1512 microversion: 2.1 time: 0.170837 Aug 09 16:55:39.410597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 338/646] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:39 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:40.034457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:40.035233 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:40.048276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:40.048766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:40.049300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:40.054445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:40.054445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:40.054445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:40.184019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:40.192234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-65afc335-7ce8-44bd-bde1-38cff7bf5178 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1722 microversion: 2.1 time: 0.161371 Aug 09 16:55:40.192809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 309/647] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:40 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:40.431989 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:40.432610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:40.439038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:40.439535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:40.439978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:40.440680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:40.441135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:40.441562 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:40.571430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:40.579052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3cc663da-29c2-444c-b404-46378b91984e tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1512 microversion: 2.1 time: 0.151237 Aug 09 16:55:40.579641 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 339/648] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:40 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:41.214676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:41.215290 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:41.221816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:41.222294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:41.222728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:41.223448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:41.223902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:41.224322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:41.359020 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:41.366882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8d43ec47-9199-4fa8-ac22-3b07477c2baa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1728 microversion: 2.1 time: 0.156736 Aug 09 16:55:41.367541 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 310/649] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:41 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:41.390204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:41.390694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:41.396722 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:41.397205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:41.397642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:41.398333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:41.398787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:41.399247 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:41.478990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ea6ae33d-969d-4264-b502-3a0944ccffb1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092577 Aug 09 16:55:41.479612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 340/650] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:55:41 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:41.599906 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:41.600521 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:41.606450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:41.606938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:41.607410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:41.608110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:41.608562 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:41.608986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:41.738255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:41.746534 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1b7c7ded-22d5-4ed0-882a-e64b90715023 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1512 microversion: 2.1 time: 0.150406 Aug 09 16:55:41.747141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 311/651] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:41 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:42.624679 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-9f068532-48e3-4043-9be9-62ae9e9501fc req-1fe4b2b8-6689-44b6-a42d-93fb1a5a6a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a826f525-18be-4776-9042-856d0854971e", "name": "network-vif-deleted", "tag": "259f97dc-abea-4d59-9f06-f3de84cf5fd5"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:42.634047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-9f068532-48e3-4043-9be9-62ae9e9501fc req-1fe4b2b8-6689-44b6-a42d-93fb1a5a6a35 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:42.634612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-9f068532-48e3-4043-9be9-62ae9e9501fc req-1fe4b2b8-6689-44b6-a42d-93fb1a5a6a35 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:42.635345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-9f068532-48e3-4043-9be9-62ae9e9501fc req-1fe4b2b8-6689-44b6-a42d-93fb1a5a6a35 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:42.646760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-9f068532-48e3-4043-9be9-62ae9e9501fc req-1fe4b2b8-6689-44b6-a42d-93fb1a5a6a35 service nova] Creating event network-vif-deleted:259f97dc-abea-4d59-9f06-f3de84cf5fd5 for instance a826f525-18be-4776-9042-856d0854971e on hv-cinder-85236 Aug 09 16:55:42.652023 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-9f068532-48e3-4043-9be9-62ae9e9501fc req-1fe4b2b8-6689-44b6-a42d-93fb1a5a6a35 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Aug 09 16:55:42.652630 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 341/652] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:42.720261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-a8bb526f-3934-4246-94cd-03e02425861b req-b59402f3-9697-4b01-99e4-0178d59edcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f72561-f391-43d4-8264-28016993a6a5", "tag": "9f544325-972f-4e60-9365-73a4114a5bfb"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:42.732294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a8bb526f-3934-4246-94cd-03e02425861b req-b59402f3-9697-4b01-99e4-0178d59edcc6 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:42.733513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a8bb526f-3934-4246-94cd-03e02425861b req-b59402f3-9697-4b01-99e4-0178d59edcc6 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:42.734166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-a8bb526f-3934-4246-94cd-03e02425861b req-b59402f3-9697-4b01-99e4-0178d59edcc6 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:42.754556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-a8bb526f-3934-4246-94cd-03e02425861b req-b59402f3-9697-4b01-99e4-0178d59edcc6 service nova] Creating event network-changed:9f544325-972f-4e60-9365-73a4114a5bfb for instance 53f72561-f391-43d4-8264-28016993a6a5 on hv-cinder-85236 Aug 09 16:55:42.759680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-a8bb526f-3934-4246-94cd-03e02425861b req-b59402f3-9697-4b01-99e4-0178d59edcc6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043613 Aug 09 16:55:42.760402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 312/653] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:42.767979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:42.768692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:42.774891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:42.775417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:42.775859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:42.776561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:42.777020 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:42.777510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:42.843431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:42.852723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e293d6bc-0e91-4022-9cde-41a538181953 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1470 microversion: 2.1 time: 0.088858 Aug 09 16:55:42.857776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 342/654] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:42 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1470 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:43.876476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:43.877187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:43.883433 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:43.884039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:43.884448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:43.885147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:43.885608 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:43.886048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:43.919434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:43.919807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:43.920284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:43.920728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lazy-loading 'fault' on Instance uuid a826f525-18be-4776-9042-856d0854971e {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:55:43.962792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88960dd0da2c4bb39e4fc1f773636231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea828531a5d468a9f15381d47e1594e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:43.970808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-baadae2d-4cf1-4995-aabe-2a519250b992 tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 200 len: 1308 microversion: 2.1 time: 0.099075 Aug 09 16:55:43.971407 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 313/655] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:43 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:44.779663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-d7bd292b-a088-472c-b6e3-bc06d3a571b8 req-517dad90-be85-4d38-81ac-f08eabb61d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f72561-f391-43d4-8264-28016993a6a5", "tag": "9f544325-972f-4e60-9365-73a4114a5bfb"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:44.789493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d7bd292b-a088-472c-b6e3-bc06d3a571b8 req-517dad90-be85-4d38-81ac-f08eabb61d4d service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:44.789969 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d7bd292b-a088-472c-b6e3-bc06d3a571b8 req-517dad90-be85-4d38-81ac-f08eabb61d4d service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:44.790434 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d7bd292b-a088-472c-b6e3-bc06d3a571b8 req-517dad90-be85-4d38-81ac-f08eabb61d4d service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:44.802958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-d7bd292b-a088-472c-b6e3-bc06d3a571b8 req-517dad90-be85-4d38-81ac-f08eabb61d4d service nova] Creating event network-changed:9f544325-972f-4e60-9365-73a4114a5bfb for instance 53f72561-f391-43d4-8264-28016993a6a5 on hv-cinder-85236 Aug 09 16:55:44.809659 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-d7bd292b-a088-472c-b6e3-bc06d3a571b8 req-517dad90-be85-4d38-81ac-f08eabb61d4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Aug 09 16:55:44.810268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 343/656] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:44.993605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:44.994997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] [instance: a826f525-18be-4776-9042-856d0854971e] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:45.001680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:45.002162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:45.002600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:45.003349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:45.003817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:45.004270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:45.017907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] HTTP exception thrown: Instance a826f525-18be-4776-9042-856d0854971e could not be found. Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Request method failure captured: Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e HTTP/1.1 Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pDg6sLrCa2rmltyk-_IA1vlQoTtwcmW7zdbXBjfPaV-BprzyKqH8kDGzHSA-0dwvEBP4-jjOPTsoc3H1kekDKVS0AlwIEgEvCUW7ll6bTI0P1T9gLz7i8aYFaYoQlXzpaqz_jkeCAZuwLPWahQrzPBdVTGrimm3CXY1PVsb89Klb-E Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 7ea828531a5d468a9f15381d47e1594e Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesSnapshotTestJSON-308951325 Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:55:45.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ea828531a5d468a9f15381d47e1594e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7ea828531a5d468a9f15381d47e1594e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7ea828531a5d468a9f15381d47e1594e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ea828531a5d468a9f15381d47e1594e"}]}] Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesSnapshotTestJSON-308951325 Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 7ea828531a5d468a9f15381d47e1594e Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-308951325 Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesSnapshotTestJSON-308951325-project Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 88960dd0da2c4bb39e4fc1f773636231 Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesSnapshotTestJSON-308951325-project Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance a826f525-18be-4776-9042-856d0854971e could not be found. Aug 09 16:55:45.021114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'a826f525-18be-4776-9042-856d0854971e'} Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a826f525-18be-4776-9042-856d0854971e could not be found. Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:55:45.022482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a826f525-18be-4776-9042-856d0854971e could not be found. Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a826f525-18be-4776-9042-856d0854971e could not be found. Aug 09 16:55:45.024051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:45.026039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] Returning 404 to user: Instance a826f525-18be-4776-9042-856d0854971e could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:55:45.026039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3ecc4201-7f0d-4eb6-85ff-281f89f421dc tempest-VolumesSnapshotTestJSON-308951325 tempest-VolumesSnapshotTestJSON-308951325-project] 10.222.0.59 "GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e" status: 404 len: 111 microversion: 2.1 time: 0.031478 Aug 09 16:55:45.026039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 314/657] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:44 2022] GET /compute/v2.1/servers/a826f525-18be-4776-9042-856d0854971e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:55:45.613327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:45.615589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:45.622586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:45.623070 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:45.623531 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:45.624231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:45.624694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:45.625118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:45.641604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:45.657747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-12482cb7-d342-4b64-a01a-c7466e4a8924 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048615 Aug 09 16:55:45.658486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 344/658] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:55:45 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 16:55:45.722983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:45.723606 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:45.730406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:45.730961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:45.731493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:45.735498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:45.735498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:45.735498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:45.758044 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:55:46.229410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-980a0d24-f215-48f7-aa4f-1fd8e123d591 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 204 len: 0 microversion: 2.1 time: 0.510231 Aug 09 16:55:46.230061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 315/659] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:55:45 2022] DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:55:46.237978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:46.238595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:46.246517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:46.246998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:46.247471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:46.248167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:46.248633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:46.249058 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:46.379260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:46.386757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0e714582-d020-4344-9fcf-1deb05871b1e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1675 microversion: 2.1 time: 0.152619 Aug 09 16:55:46.387363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 345/660] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:46 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:47.409356 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:47.410069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:47.416831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:47.417342 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:47.417794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:47.418481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:47.418949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:47.419494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:47.551471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:47.559915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-73302fb2-0684-4abc-8ddc-49e44db1ded0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1675 microversion: 2.1 time: 0.154869 Aug 09 16:55:47.560508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 316/661] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:47 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:48.582380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:48.582998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:48.590290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:48.590783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:48.591252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:48.591951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:48.592412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:48.592841 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:48.723121 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:48.730706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-37ad9012-71c1-4964-b72c-240285d60e54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1675 microversion: 2.1 time: 0.152533 Aug 09 16:55:48.731523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 346/662] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:48 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:49.752520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:49.753063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:49.759512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:49.760323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:49.760763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:49.761450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:49.761917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:49.762320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:49.895405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:49.898852 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:49.903722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e2dfd92f-f913-4f96-9ab6-dc05c7fa84c0 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1675 microversion: 2.1 time: 0.155099 Aug 09 16:55:49.904299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 317/663] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:49 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:50.926040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:50.926682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:50.934403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:50.935001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:50.935549 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:50.936242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:50.936693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:50.937111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:51.076550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:51.084143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6715a808-88a2-4904-b3ac-f81587add5c3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1675 microversion: 2.1 time: 0.162139 Aug 09 16:55:51.084761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 347/664] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:50 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:51.810231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-4f3e7cff-8931-4257-8fbb-005ed3c3f116 req-acf4d02f-b0be-430e-8685-2cbcd94837f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a274d0-9d37-4f6f-8a7e-2f223cf42198", "name": "network-vif-deleted", "tag": "c7c7c2fe-a482-49a1-bef6-cb7da54c233e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:51.819532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4f3e7cff-8931-4257-8fbb-005ed3c3f116 req-acf4d02f-b0be-430e-8685-2cbcd94837f7 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:51.820087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4f3e7cff-8931-4257-8fbb-005ed3c3f116 req-acf4d02f-b0be-430e-8685-2cbcd94837f7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:51.820738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4f3e7cff-8931-4257-8fbb-005ed3c3f116 req-acf4d02f-b0be-430e-8685-2cbcd94837f7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:51.833995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-4f3e7cff-8931-4257-8fbb-005ed3c3f116 req-acf4d02f-b0be-430e-8685-2cbcd94837f7 service nova] Creating event network-vif-deleted:c7c7c2fe-a482-49a1-bef6-cb7da54c233e for instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 on hv-cinder-85236 Aug 09 16:55:51.841260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-4f3e7cff-8931-4257-8fbb-005ed3c3f116 req-acf4d02f-b0be-430e-8685-2cbcd94837f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038324 Aug 09 16:55:51.842788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 318/665] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:52.107591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:52.108198 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:52.110496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=72 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:52.115443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:52.123898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:52.123898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:52.123898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:52.123898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:52.124403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:52.186424 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:52.194177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-faf04e03-3e19-4a5f-87ea-b567be057184 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 200 len: 1323 microversion: 2.1 time: 0.091512 Aug 09 16:55:52.194752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 348/666] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:52 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:53.217301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:53.217929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:53.225242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:53.227309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:53.227309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:53.227309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:53.227309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:53.227748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:53.241928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] HTTP exception thrown: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Request method failure captured: Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 HTTP/1.1 Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBbk8TUme3G-BGb-8at5esUYtUMmE61Ykdd3mLi5bOld12A0ChcYAi1YDNwpYS8wfHtI-oFBJRzOSEtiK8BeGseFOlr6MFSp0D7qGb_O9eW-XXNvLKqUPJBwRbr8ZPZ19uDNYW2QgNcjCtAvzBJnO8lO7XwhUGOp8NHRdiHQ7b6eQw Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:55:53.243576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_54562f03aaae457ca88be251d2208e2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}] Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 7c0e3a34f13440b38fdf0ced22dc5a01 Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:55:53.245704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'e7a274d0-9d37-4f6f-8a7e-2f223cf42198'} Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:55:53.246457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:55:53.247823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:55:53.249203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Returning 404 to user: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:55:53.249203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d30ec06f-1170-4409-a9aa-c836fbe7a91b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 404 len: 111 microversion: 2.1 time: 0.034276 Aug 09 16:55:53.249203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 319/667] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:53 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:55:53.255390 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8c521a16-ad53-46a6-af24-544e241da301 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '.version_select at 0x7fccc4bea550>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:53.430139 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8c521a16-ad53-46a6-af24-544e241da301 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219298482" status: 202 len: 0 microversion: 2.1 time: 0.178798 Aug 09 16:55:53.430733 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 349/668] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 16:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219298482 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:55:54.477546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9d373b93-c4b2-489c-b57e-306e1cd06e5e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: .version_select at 0x7fccc4b9c1f0>, body: {"keypair": {"name": "tempest-keypair-1737823856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGXM6BuvfJgeiDAFig8l8Xrm7JchlULQ2p3y7Zu5vp1d+mBe5T5RRtYJ8XXOd8Wl2GeNJI/prsZuEZ/TEps619jTvr1DDoMec+M5pt1g/KvarMq/R9jMXX8dtkFyRHmdQ=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:54.495328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-9d373b93-c4b2-489c-b57e-306e1cd06e5e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for project 54562f03aaae457ca88be251d2208e2e. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:55:54.499164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-9d373b93-c4b2-489c-b57e-306e1cd06e5e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for user 7c0e3a34f13440b38fdf0ced22dc5a01 and project 54562f03aaae457ca88be251d2208e2e. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:55:54.627086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9d373b93-c4b2-489c-b57e-306e1cd06e5e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153498 Aug 09 16:55:54.627743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 320/669] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:55:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:55:57.376962 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-250281683", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6e9ea29-d63f-40f2-84ee-974e268aa2d8"}], "security_groups": [{"name": "tempest-securitygroup--904794118"}], "key_name": "tempest-keypair-1737823856", "user_data": "}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:55:57.480186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] validate_networks() for [('c6e9ea29-d63f-40f2-84ee-974e268aa2d8', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:55:57.890515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:55:57.890941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:55:57.891456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:55:57.891900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:55:57.892360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:55:57.901256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:57.901741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:57.902180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:57.902910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:57.903426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:57.903857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:57.921973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for project 54562f03aaae457ca88be251d2208e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:55:57.925965 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Getting quotas for user 7c0e3a34f13440b38fdf0ced22dc5a01 and project 54562f03aaae457ca88be251d2208e2e. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:55:57.937364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:55:57.939631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:55:58.105113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5ab7d779-ed15-4379-b10a-54b49ae143b5 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.732830 Aug 09 16:55:58.105692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 350/670] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:55:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:55:58.117798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-98e5bfae-1d85-42bb-8e46-9ed6e71c7176 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:58.118416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-98e5bfae-1d85-42bb-8e46-9ed6e71c7176 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:58.123087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:55:58.178374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-98e5bfae-1d85-42bb-8e46-9ed6e71c7176 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:58.185986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-98e5bfae-1d85-42bb-8e46-9ed6e71c7176 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1237 microversion: 2.1 time: 0.073131 Aug 09 16:55:58.186637 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 321/671] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:58 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:55:59.209912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:55:59.210529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:55:59.217417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:59.217902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:59.218341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:59.219044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:55:59.219534 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:55:59.219963 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:55:59.282669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:55:59.290028 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4e2b8abd-e553-4fd5-ab44-3c53b2c35e57 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1241 microversion: 2.1 time: 0.084539 Aug 09 16:55:59.290596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 351/672] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:55:59 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:00.311353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:00.311989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:00.319522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:00.320034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:00.320558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:00.321299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:00.321805 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:00.322288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:00.388469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:00.396112 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b7a9f049-f8cb-4902-9ffc-7ff756830c54 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1241 microversion: 2.1 time: 0.088832 Aug 09 16:56:00.402745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 322/673] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:00 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:01.418307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:01.418951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:01.425332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:01.425947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:01.426474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:01.427327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:01.427919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:01.428454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:01.507092 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:01.515611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9d5f2b5c-d8fa-43c9-9a02-99210e049137 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1289 microversion: 2.1 time: 0.102369 Aug 09 16:56:01.516265 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 352/674] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:01 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:02.537305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:02.537918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:02.544515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:02.544996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:02.545436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:02.546123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:02.546578 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:02.547027 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:02.622626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:02.631377 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-afdd3ccb-cebe-4318-9c96-f06f06d465f3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1307 microversion: 2.1 time: 0.097808 Aug 09 16:56:02.631982 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 323/675] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:02 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:03.653220 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:03.653923 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:03.660407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:03.660931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:03.661367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:03.662059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:03.662516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:03.662945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:03.806546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:03.813890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4c7d8e54-2947-4355-824b-7d622f8ae411 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.164563 Aug 09 16:56:03.815017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 353/676] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:03 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:04.369649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-031eea83-6574-49a3-a3d7-f18dc214e453 req-f62b7cdd-1216-40cc-a9d3-704b87056a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1229920f-1e1c-47ed-b793-477ffc82d0c7", "tag": "9cab5e90-f175-4329-b086-0861ea05f1e3"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:04.378970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-031eea83-6574-49a3-a3d7-f18dc214e453 req-f62b7cdd-1216-40cc-a9d3-704b87056a4b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:04.379505 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-031eea83-6574-49a3-a3d7-f18dc214e453 req-f62b7cdd-1216-40cc-a9d3-704b87056a4b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:04.379937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-031eea83-6574-49a3-a3d7-f18dc214e453 req-f62b7cdd-1216-40cc-a9d3-704b87056a4b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:04.390936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-031eea83-6574-49a3-a3d7-f18dc214e453 req-f62b7cdd-1216-40cc-a9d3-704b87056a4b service nova] Creating event network-changed:9cab5e90-f175-4329-b086-0861ea05f1e3 for instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 on hv-cinder-85236 Aug 09 16:56:04.395782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-031eea83-6574-49a3-a3d7-f18dc214e453 req-f62b7cdd-1216-40cc-a9d3-704b87056a4b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095636 Aug 09 16:56:04.396361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 324/677] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:04.836040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:04.836681 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:04.843741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:04.844228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:04.844663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:04.845354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:04.845809 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:04.846234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:04.981695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:04.989260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f4dfba6c-3d46-4622-9cf1-8486e7511284 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.157086 Aug 09 16:56:04.989842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 354/678] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:04 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:06.012315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:06.013041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:06.019235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:06.019715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:06.021538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:06.021538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:06.021538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:06.022357 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:06.158585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:06.166040 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d84cf7d4-1a07-4f4d-a492-78239a9b9e0a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.159844 Aug 09 16:56:06.166707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 325/679] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:06 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:07.187342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:07.187950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:07.194476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:07.198844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:07.198844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:07.198844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:07.198844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:07.199271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:07.331575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:07.339719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-317ccee3-cae9-490d-a6c3-eaf835f678a7 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.156286 Aug 09 16:56:07.340295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 355/680] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:07 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:08.361009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:08.361760 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:08.364121 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=6 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:08.369925 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:08.370620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:08.371061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:08.371876 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:08.372351 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:08.372778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:08.507381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:08.515181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e6fdd70a-5ee1-4f22-8896-c0a59b8505af tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.158319 Aug 09 16:56:08.515742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 326/681] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:08 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:08.973299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-71fe41c3-6071-40b0-b590-ede0890a27e9 req-13b46747-fe4d-43b4-b3d3-7d9a35996dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1229920f-1e1c-47ed-b793-477ffc82d0c7", "name": "network-vif-plugged", "status": "completed", "tag": "9cab5e90-f175-4329-b086-0861ea05f1e3"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:08.978618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:08.983241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=6 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:08.985675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-71fe41c3-6071-40b0-b590-ede0890a27e9 req-13b46747-fe4d-43b4-b3d3-7d9a35996dec service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:08.986182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-71fe41c3-6071-40b0-b590-ede0890a27e9 req-13b46747-fe4d-43b4-b3d3-7d9a35996dec service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:08.986613 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-71fe41c3-6071-40b0-b590-ede0890a27e9 req-13b46747-fe4d-43b4-b3d3-7d9a35996dec service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:08.998457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-71fe41c3-6071-40b0-b590-ede0890a27e9 req-13b46747-fe4d-43b4-b3d3-7d9a35996dec service nova] Creating event network-vif-plugged:9cab5e90-f175-4329-b086-0861ea05f1e3 for instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 on hv-cinder-85236 Aug 09 16:56:09.003912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-71fe41c3-6071-40b0-b590-ede0890a27e9 req-13b46747-fe4d-43b4-b3d3-7d9a35996dec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034419 Aug 09 16:56:09.004573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 356/682] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:09.232615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:09.234099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:09.242957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:09.242957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:09.242957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:09.242957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:09.243399 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:09.243498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:09.268973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:56:09.538255 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:09.538883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:09.545454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:09.545936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:09.546373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:09.547064 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:09.547592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:09.548047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:09.678125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:09.686285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1c745239-7c3f-42ea-be49-80cfdfa4a235 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.152972 Aug 09 16:56:09.687195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 357/683] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:09 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:09.935095 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-372bd140-ee9c-4aaf-bf75-d4f01aa65cb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 204 len: 0 microversion: 2.1 time: 0.706697 Aug 09 16:56:09.935836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 327/684] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:56:09 2022] DELETE /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:56:09.944110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:09.944722 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:09.950835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:09.954110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:09.954110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:09.954110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:09.954110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:09.954475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:10.093493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:10.101269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9dd4cdbb-199a-4314-a21b-f752d5d5dd23 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1576 microversion: 2.1 time: 0.161212 Aug 09 16:56:10.101875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 358/685] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:09 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:10.708847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:10.709667 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:10.716896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:10.717373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:10.717803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:10.718486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:10.718932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:10.719376 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:10.852149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:10.860547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6edf01ad-a26a-41cb-b057-da8169ad00ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.155869 Aug 09 16:56:10.861118 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 328/686] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:10 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:11.123513 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:11.124133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:11.130112 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:11.130590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:11.133576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:11.133576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:11.133576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:11.133576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:11.267502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:11.275061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d27c1d94-0ab1-41f5-a1d0-a8fafdb6d366 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1576 microversion: 2.1 time: 0.156101 Aug 09 16:56:11.276292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 359/687] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:11 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:11.880970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:11.881585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:11.888163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:11.888642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:11.889079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:11.889777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:11.890221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:11.890647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:12.031601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:12.039431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c3a066dc-ed67-4f0d-9533-97eaaea64c34 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1362 microversion: 2.1 time: 0.162246 Aug 09 16:56:12.040046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 329/688] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:11 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:12.297310 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:12.298022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:12.304375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:12.304859 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:12.305306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:12.306002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:12.306977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:12.307529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:12.445314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:12.453773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3fdb23da-45a6-4e70-b1dd-51f2ff979935 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1576 microversion: 2.1 time: 0.160315 Aug 09 16:56:12.456881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 360/689] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:12 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:13.061250 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:13.061878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:13.068510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:13.068977 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:13.069412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:13.070190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:13.070655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:13.071075 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:13.275909 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:13.283887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fa66f88f-3cb7-4792-8535-26cdffee85b3 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1548 microversion: 2.1 time: 0.226512 Aug 09 16:56:13.295310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 330/690] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:13 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:13.310354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:13.310854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:13.317126 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:13.317619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:13.318312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:13.319006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:13.319656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:13.320077 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:13.431645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f10c7019-343a-484b-b3bb-a94d63306adc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123054 Aug 09 16:56:13.431645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 361/691] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:56:13 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:13.474390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:13.475081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:13.481551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:13.482041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:13.482474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:13.483236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:13.483692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:13.484294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:13.738490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:13.747610 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-155cd6a4-6d17-4cdd-907c-645ee3bffd98 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1576 microversion: 2.1 time: 0.276928 Aug 09 16:56:13.748780 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 331/692] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:13 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1576 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:14.216083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-bee8c274-73ad-4e39-b7b4-6412022cbfd3 req-5fc66a96-76d6-47cd-b5f9-eed3769770ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6dea3ef-6792-4471-ba10-60009659c637", "name": "network-vif-deleted", "tag": "7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:14.226260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-bee8c274-73ad-4e39-b7b4-6412022cbfd3 req-5fc66a96-76d6-47cd-b5f9-eed3769770ab service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:14.227052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-bee8c274-73ad-4e39-b7b4-6412022cbfd3 req-5fc66a96-76d6-47cd-b5f9-eed3769770ab service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:14.227537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-bee8c274-73ad-4e39-b7b4-6412022cbfd3 req-5fc66a96-76d6-47cd-b5f9-eed3769770ab service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:14.240450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-bee8c274-73ad-4e39-b7b4-6412022cbfd3 req-5fc66a96-76d6-47cd-b5f9-eed3769770ab service nova] Creating event network-vif-deleted:7894ce6f-cdea-4930-bb7f-7cb16ee8e5c0 for instance d6dea3ef-6792-4471-ba10-60009659c637 on hv-cinder-85236 Aug 09 16:56:14.246204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-bee8c274-73ad-4e39-b7b4-6412022cbfd3 req-5fc66a96-76d6-47cd-b5f9-eed3769770ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Aug 09 16:56:14.246855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 362/693] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:14.771633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:14.772355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:14.785131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:14.787991 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:14.788783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:14.793004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:14.793004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:14.793004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:14.872503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:14.882452 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fe0385c6-2785-4de8-a6e7-7170ecd851f7 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1225 microversion: 2.1 time: 0.115886 Aug 09 16:56:14.908181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 332/694] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:14 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:14.998806 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-be94d523-48df-4e65-8060-113499c55f13 req-1b4bb7ce-8ecc-41c4-90b0-5004c864b42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1229920f-1e1c-47ed-b793-477ffc82d0c7", "tag": "9cab5e90-f175-4329-b086-0861ea05f1e3"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:15.013798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-be94d523-48df-4e65-8060-113499c55f13 req-1b4bb7ce-8ecc-41c4-90b0-5004c864b42a service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:15.014606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-be94d523-48df-4e65-8060-113499c55f13 req-1b4bb7ce-8ecc-41c4-90b0-5004c864b42a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:15.015224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-be94d523-48df-4e65-8060-113499c55f13 req-1b4bb7ce-8ecc-41c4-90b0-5004c864b42a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:15.039136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-be94d523-48df-4e65-8060-113499c55f13 req-1b4bb7ce-8ecc-41c4-90b0-5004c864b42a service nova] Creating event network-changed:9cab5e90-f175-4329-b086-0861ea05f1e3 for instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 on hv-cinder-85236 Aug 09 16:56:15.039136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-be94d523-48df-4e65-8060-113499c55f13 req-1b4bb7ce-8ecc-41c4-90b0-5004c864b42a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249593 Aug 09 16:56:15.039136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 363/695] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:56:15.907908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:15.908484 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:15.915371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:15.916575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:15.917405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:15.917944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:15.918397 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:15.918819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:15.955234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:15.955719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:15.956151 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:15.956602 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lazy-loading 'fault' on Instance uuid d6dea3ef-6792-4471-ba10-60009659c637 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:16.196469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:16.212292 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1ecd5c1f-5cd6-4f14-b14b-20c2481d210e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 200 len: 1230 microversion: 2.1 time: 0.308071 Aug 09 16:56:16.227722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 333/696] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:15 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 1230 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:17.236580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:17.237650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:17.244226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:17.245174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:17.245174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:17.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:17.246391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:17.246815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:17.261509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] HTTP exception thrown: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Request method failure captured: Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 HTTP/1.1 Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pCz-K1d3REQuzRimtPCwcU1YZ4NE2ud_SAfPJnEFclyJ7Q2JKjgiwzz-a9VEqkrCs0O1JYG0jlW5f0gOzskuri0knSsS3BWCAubqcWSgGfLk8_bu4TmUTPHJUGQIxYY4UUxQzv91tFj27JgkSKCschAQz3osL1VOT3BKQFMsD4H8QU Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:56:17.263187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5e7f48ecafa4bfe80fadd50e0b24cbb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}] Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-TestVolumeBootPattern-1954653577 Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-TestVolumeBootPattern-1954653577-project Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 02b21bed2f2d4e58b3759349331d44c7 Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-TestVolumeBootPattern-1954653577-project Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 16:56:17.264813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'd6dea3ef-6792-4471-ba10-60009659c637'} Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:56:17.265788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 16:56:17.267373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:17.268690 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Returning 404 to user: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:56:17.268690 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-298bb7ac-3722-4a9c-851d-c480a27ee0dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 404 len: 111 microversion: 2.1 time: 0.032826 Aug 09 16:56:17.268690 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 364/697] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:17 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:56:17.363547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-498289263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-983199229", "security_groups": [{"name": "tempest-secgroup-smoke-1542149782"}], "block_device_mapping_v2": [{"uuid": "7ff5108e-1360-4dec-8e0b-ec46a6a95a10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03ca7ab9-4a6d-42ee-86c4-e644a355c008"}]}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:17.501739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] validate_networks() for [('03ca7ab9-4a6d-42ee-86c4-e644a355c008', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:56:17.978176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:56:17.978685 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:56:17.979218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:56:17.979636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:56:17.980053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:56:17.989232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:17.989721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:17.990158 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:17.990882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:17.991386 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:17.991811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:18.008875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:56:18.014669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for user 02b21bed2f2d4e58b3759349331d44c7 and project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:56:18.077101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:56:18.079546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ff5108e-1360-4dec-8e0b-ec46a6a95a10',volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:56:18.725707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-09568bc0-bead-47d0-8df7-45dc28300474 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.365949 Aug 09 16:56:18.727051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 334/698] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:56:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:56:18.737688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-32876f90-9292-4646-827d-7f53e879f109 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:18.738230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-32876f90-9292-4646-827d-7f53e879f109 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:18.795090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-32876f90-9292-4646-827d-7f53e879f109 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:18.801878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-32876f90-9292-4646-827d-7f53e879f109 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1093 microversion: 2.1 time: 0.067966 Aug 09 16:56:18.802319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 365/699] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:18 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:19.822228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:19.823030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:19.830467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:19.830951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:19.831425 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:19.832116 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:19.832568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:19.832987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:19.893495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:19.901670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-599f4b99-5006-4e2e-b968-80f3a8229e5e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1143 microversion: 2.1 time: 0.083521 Aug 09 16:56:19.902248 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 335/700] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:19 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:20.922502 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:20.923132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:20.930688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:20.931207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:20.932289 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:20.932979 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:20.933435 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:20.933860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:20.936580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=95 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:20.993474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:21.001631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0798c154-4f36-4e78-a3d8-31e8a2537c14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1143 microversion: 2.1 time: 0.083087 Aug 09 16:56:21.002182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 366/701] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:20 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:22.022215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:22.023009 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:22.029876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:22.030362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:22.031037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:22.031507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:22.032017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:22.032446 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:22.063328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:22.066475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:22.070181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:22.070752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:22.071316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:22.072221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:22.072747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:22.073306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:22.105994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:22.106216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ed933188-780e-41b1-9f81-d439ed8ceef2 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/ips" status: 200 len: 149 microversion: 2.1 time: 0.204141 Aug 09 16:56:22.106216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 336/702] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:56:21 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/ips => generated 149 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:22.106848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c0b24bdb-8d04-46d0-911b-4c228450b254 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1143 microversion: 2.1 time: 0.087424 Aug 09 16:56:22.106848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 367/703] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:22 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:23.126475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:23.127171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:23.134137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:23.135242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:23.135687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:23.136424 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:23.136873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:23.137302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:23.155995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:23.200807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:23.208620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e006b422-fe58-4fff-9bb5-4586c2844a53 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1191 microversion: 2.1 time: 0.086488 Aug 09 16:56:23.209188 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 337/704] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:23 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:23.610955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:23.611557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:23.613935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:23.619736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:23.627982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:23.627982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:23.627982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:23.627982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:23.628400 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:23.712369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'services' on Instance uuid 53f72561-f391-43d4-8264-28016993a6a5 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:23.871362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:23.873759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:23.880528 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:23.890795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:23.890795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:23.890795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:23.890795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:23.891227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:24.082562 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-60257a5a-2446-4284-bb6e-19014065f67e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments/cae8add1-f3cb-4ce8-a1ae-685db9c45c76" status: 202 len: 0 microversion: 2.1 time: 0.475481 Aug 09 16:56:24.083228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 368/705] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:56:23 2022] DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments/cae8add1-f3cb-4ce8-a1ae-685db9c45c76 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:56:24.092639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:24.095013 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:24.101893 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:24.102379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:24.102808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:24.104151 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:24.104715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:24.105139 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:24.137019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d6d0774b-4233-461e-90a8-7df97af19722 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049028 Aug 09 16:56:24.137503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 369/706] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:24 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:56:24.231054 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:24.231904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:24.238842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:24.239362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:24.239800 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:24.244934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:24.244934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:24.244934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:24.312485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:24.320329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fc2df036-522f-4045-bfb2-351da95e24b4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1209 microversion: 2.1 time: 0.093851 Aug 09 16:56:24.321179 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 370/707] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:24 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:24.924611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-90d1bb93-dd5b-44ec-8726-2239af860e3c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.058315 Aug 09 16:56:24.925248 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 338/708] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:56:23 2022] POST /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 194 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:56:25.149373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:25.151771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:25.158567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:25.159053 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:25.159561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:25.160259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:25.160715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:25.161140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:25.190904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6688f281-f3af-4fdd-970f-fa8c7fa9f559 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 09 16:56:25.191419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 371/709] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:25 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:25.342957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:25.343714 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:25.349880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:25.350370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:25.350800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:25.351534 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:25.351987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:25.352408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:25.489260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:25.498139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f8b81694-e743-4557-bceb-83cdf0fd4d26 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1277 microversion: 2.1 time: 0.159883 Aug 09 16:56:25.498715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 339/710] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:25 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:26.203432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:26.205738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:26.212913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:26.213428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:26.213892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:26.214613 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:26.215072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:26.215545 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:26.246583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e801204a-ea3d-4335-8f23-422814c7ca00 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047289 Aug 09 16:56:26.247093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 372/711] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:26 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:26.519257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:26.519804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:26.526724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:26.527222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:26.527749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:26.528466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:26.528920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:26.529340 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:26.663427 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:26.671846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d3f754fe-b015-47dc-9bfc-9c747ed309f1 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1277 microversion: 2.1 time: 0.156383 Aug 09 16:56:26.672336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 340/712] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:26 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:27.114875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:27.116493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:27.126243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.127615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.127615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.128086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.128745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.129357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.176905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1512b9d9-d5a1-4335-82a5-6825c1915b0a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments/5c80f995-09fd-42da-a116-3fddde0b67db" status: 200 len: 194 microversion: 2.20 time: 0.081322 Aug 09 16:56:27.179494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 373/713] 10.222.0.59 () {60 vars in 1454 bytes} [Tue Aug 9 16:56:27 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments/5c80f995-09fd-42da-a116-3fddde0b67db => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:27.246316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:27.248530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:27.252878 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.253123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.253497 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.254272 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.254656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.255073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.258824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:27.261448 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:27.269518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.270007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.270442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.271215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.271675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.272322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.306113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1170df7c-65e5-4e73-af49-e1d6b7cc56d7 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051956 Aug 09 16:56:27.307251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 374/714] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:27 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:56:27.342713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lazy-loading 'services' on Instance uuid da7f4d33-f0b3-4448-9f68-813a5aead47a {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:27.606420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-aa5aa4c1-f178-46d5-9198-0c82c1bbd51e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments/5c80f995-09fd-42da-a116-3fddde0b67db" status: 202 len: 0 microversion: 2.20 time: 0.364338 Aug 09 16:56:27.607282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 341/715] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Aug 9 16:56:27 2022] DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments/5c80f995-09fd-42da-a116-3fddde0b67db => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:56:27.615753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:27.618021 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:27.624961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.625490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.625932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.626634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.627165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.627611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.657683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1879c980-14de-4f38-9c0b-a61b328c5025 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046009 Aug 09 16:56:27.658266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 375/716] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:27 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:27.691510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-67487aa4-9af0-4b81-a092-368bbe1ec931 req-44de0de2-dcaf-4839-98f7-1eb6dd0d6c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daaa8cc-0b52-422c-adaa-98f905bb869b", "tag": "de1305b9-b3fe-416b-8157-bf1c65b0aa2a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:27.692622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:27.693507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:27.700408 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.701095 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.701490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.702200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.702657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.703171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.704435 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-67487aa4-9af0-4b81-a092-368bbe1ec931 req-44de0de2-dcaf-4839-98f7-1eb6dd0d6c24 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:27.705045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-67487aa4-9af0-4b81-a092-368bbe1ec931 req-44de0de2-dcaf-4839-98f7-1eb6dd0d6c24 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:27.705555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-67487aa4-9af0-4b81-a092-368bbe1ec931 req-44de0de2-dcaf-4839-98f7-1eb6dd0d6c24 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:27.717923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-67487aa4-9af0-4b81-a092-368bbe1ec931 req-44de0de2-dcaf-4839-98f7-1eb6dd0d6c24 service nova] Creating event network-changed:de1305b9-b3fe-416b-8157-bf1c65b0aa2a for instance 2daaa8cc-0b52-422c-adaa-98f905bb869b on hv-cinder-85236 Aug 09 16:56:27.724227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-67487aa4-9af0-4b81-a092-368bbe1ec931 req-44de0de2-dcaf-4839-98f7-1eb6dd0d6c24 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036921 Aug 09 16:56:27.727593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 342/717] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:27.850751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:27.859453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-12c28a25-c553-44cd-a653-bebd685af29e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1277 microversion: 2.1 time: 0.170576 Aug 09 16:56:27.860703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 376/718] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:27 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:28.316929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:28.317708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=6 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:28.322299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:28.324552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:28.330495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:28.330978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:28.331501 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:28.332168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:28.332622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:28.333048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:28.363466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9b74c0cb-4c2b-4461-a09c-6a2224a0d6fb tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047253 Aug 09 16:56:28.363956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 343/719] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:28 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:28.670741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:28.672942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:28.679599 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:28.680160 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:28.680599 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:28.681300 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:28.681824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:28.682246 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:28.712289 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0bc3f343-2909-403f-ab1f-3135d7a2e544 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046048 Aug 09 16:56:28.713490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 377/720] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:28 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:28.881308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:28.881925 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:28.889953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:28.890372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:28.890834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:28.891555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:28.892008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:28.892431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:29.024849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:29.032849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-00a3fff3-f09b-47b8-97aa-0abde669e2dd tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1277 microversion: 2.1 time: 0.155387 Aug 09 16:56:29.033416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 344/721] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:28 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:29.376366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:29.378556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:29.380546 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:29.385504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:29.385993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:29.386459 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:29.387177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:29.387638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:29.388071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:29.419510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c31e3900-1cbe-4dcf-ba46-4ffc6babfdfd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Aug 09 16:56:29.420105 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 378/722] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:29 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:29.725460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:29.727594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:29.734023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:29.734501 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:29.734934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:29.735646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:29.736099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:29.736525 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:29.765383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-647231f1-8975-4a6b-b35b-d560c803658a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043937 Aug 09 16:56:29.765941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 345/723] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:29 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:30.053180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:30.053795 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:30.060716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:30.061196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:30.061633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:30.062339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:30.062829 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:30.063315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:30.196654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:30.204761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-aed80d48-a5cf-4c75-813a-b8d2a1e6e112 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1277 microversion: 2.1 time: 0.155707 Aug 09 16:56:30.205334 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 379/724] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:30 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:30.431936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:30.434094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:30.440535 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:30.441027 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:30.441465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:30.442160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:30.442614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:30.443649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:30.482410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e4cd0746-0872-4f04-aa01-f03a7b98da8e tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054846 Aug 09 16:56:30.483141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 346/725] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:30 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:30.778129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:30.780227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:30.786184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:30.786662 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:30.787125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:30.787822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:30.788277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:30.788698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:30.819321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-71938249-3a38-4987-9c43-4331d1fcb5eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045243 Aug 09 16:56:30.819874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 380/726] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:30 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:31.226603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:31.227364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:31.234986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:31.235590 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:31.236123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:31.236875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:31.237359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:31.237835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:31.465346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:31.465346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-25014ad7-9225-4cb7-af32-4ac9d68358ae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1277 microversion: 2.1 time: 0.165401 Aug 09 16:56:31.465346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 347/727] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:31 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:31.495348 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:31.497375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:31.504933 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:31.505423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:31.505860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:31.506563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:31.507018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:31.507488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:31.540383 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e6a34829-ef4b-49a1-b11b-7ecfc9a5cfee tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049321 Aug 09 16:56:31.540975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 381/728] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:31 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:31.832601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:31.834792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:31.842592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:31.843074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:31.843580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:31.844276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:31.844747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:31.845164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:31.876604 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3a040adc-d862-437e-94ef-7011a4851275 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048320 Aug 09 16:56:31.877279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 348/729] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:31 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:32.488188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:32.488829 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:32.495710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.496944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.497381 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.498080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.498535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.498958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.503565 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:32.553461 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:32.556062 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:32.561494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:32.572677 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.573289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.574229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.574958 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.575450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.575882 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.619462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-64e78874-3d6d-4bea-af73-bac8b6066136 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069870 Aug 09 16:56:32.621461 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 349/730] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:32 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 16:56:32.668096 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:32.690379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6f4977ee-81da-4ff7-93cd-2a620e91199c tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.205989 Aug 09 16:56:32.691587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 382/731] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:32 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:32.716004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:32.716528 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:32.722703 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.723235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.723729 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.724577 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.724874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.725330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.754372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:56:32.889985 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:32.892452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:32.898807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.899397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.899794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.900522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:32.900980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:32.901524 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:32.938474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0f0f63d9-ee89-4840-82dd-2fd4a51d0920 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047835 Aug 09 16:56:32.938474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 383/732] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:32 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:56:33.062439 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0effc8bf-5c19-4071-8dad-39f0de7effdd tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 204 len: 0 microversion: 2.1 time: 0.350828 Aug 09 16:56:33.066682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 350/733] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:56:32 2022] DELETE /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:56:33.072372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:33.073684 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:33.081227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:33.081895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:33.082425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:33.083355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:33.083935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:33.084651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:33.229384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:33.234212 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-66955a7d-2e43-4e75-908b-c174b234ec94 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1688 microversion: 2.1 time: 0.166194 Aug 09 16:56:33.234861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 384/734] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:33 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:33.717642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:33.718304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:33.724537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:33.725057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:33.725505 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:33.726235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:33.726716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:33.727226 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:33.732046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:33.861939 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:33.869939 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ad7a2464-7439-44e6-9cc4-7881fece1491 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.157113 Aug 09 16:56:33.871192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 351/735] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:33 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:33.947543 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:33.949874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:33.956635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:33.960143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:33.960143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:33.960143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:33.960143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:33.960593 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:33.995129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-85e26bc6-c2e3-4e4a-9a3b-304bf288f9ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046635 Aug 09 16:56:33.995129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 385/736] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:33 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:34.255765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:34.256285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:34.262780 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:34.263325 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:34.263758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:34.264437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:34.264889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:34.265306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:34.397588 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:34.406126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b7580b2d-da88-4cdd-8556-ecab834a62b8 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1688 microversion: 2.1 time: 0.154862 Aug 09 16:56:34.406688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 352/737] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:34 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:34.891964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:34.892581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:34.898490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:34.901149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:34.901149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:34.901149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:34.901149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:34.902224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:35.002327 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:35.005133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:35.012452 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:35.012963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:35.013396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:35.014084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:35.014530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:35.014948 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:35.047596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1eadb0ca-5ef9-4de6-899a-27ce251082c9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049311 Aug 09 16:56:35.052294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 353/738] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:34 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:56:35.233187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:35.240696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8df61c9f-510e-4aa4-b3b3-31e0862b27f2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.352644 Aug 09 16:56:35.241255 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 386/739] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:34 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:35.427015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:35.427691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:35.434704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:35.435223 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:35.435663 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:35.436352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:35.436812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:35.437235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:35.566086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:35.574828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e13f970a-0b7a-459e-84da-4c700b0e548d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1688 microversion: 2.1 time: 0.150758 Aug 09 16:56:35.574828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 354/740] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:35 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:36.060164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:36.062304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:36.068876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:36.069361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:36.069796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:36.070488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:36.070939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:36.071394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:36.101732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b3f7c6a7-876e-499b-b7fa-66d93284cf5e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045681 Aug 09 16:56:36.102285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 387/741] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:36 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:36.262264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:36.262904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:36.269341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:36.269823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:36.270255 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:36.270945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:36.271445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:36.271865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:36.405602 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:36.412990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2bf69529-efa4-4c16-8455-3adc23077cb6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.155267 Aug 09 16:56:36.413552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 355/742] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:36 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:36.595182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:36.595824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:36.602040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:36.602678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:36.603174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:36.603912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:36.604957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:36.605467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:36.747382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:36.754996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-620299cb-c5cd-4c16-a4dd-984214b6b44d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1688 microversion: 2.1 time: 0.163630 Aug 09 16:56:36.755624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 388/743] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:36 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:37.114029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:37.116271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:37.122388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:37.122870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:37.123339 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:37.124035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:37.124491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:37.124917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:37.156435 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7955d869-4e22-4bed-b2db-56f5dd22710c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046429 Aug 09 16:56:37.157105 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 356/744] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:37 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:37.434315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:37.435235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:37.442101 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:37.442604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:37.443045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:37.444106 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:37.444570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:37.444996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:37.589618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:37.596952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e1740e31-af6d-44e4-8093-7e5ebe3cbe4e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.166615 Aug 09 16:56:37.597553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 389/745] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:37 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:37.779153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:37.779779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:37.786676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:37.787189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:37.787632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:37.788345 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:37.788804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:37.789231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:38.025019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:38.032573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-aad5ab4b-9e62-4f36-a499-63f96680c425 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1688 microversion: 2.1 time: 0.257504 Aug 09 16:56:38.033198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 357/746] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:37 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:38.171242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:38.179671 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:38.190342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:38.190823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:38.195465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:38.196384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:38.196886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:38.197322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:38.212318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-76626fcb-4199-4b28-8021-bd54daeca07e req-2dcd942a-5866-463f-939d-2507ba302a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f72561-f391-43d4-8264-28016993a6a5", "name": "network-vif-deleted", "tag": "9f544325-972f-4e60-9365-73a4114a5bfb"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:38.230066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-76626fcb-4199-4b28-8021-bd54daeca07e req-2dcd942a-5866-463f-939d-2507ba302a3a service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:38.230816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-76626fcb-4199-4b28-8021-bd54daeca07e req-2dcd942a-5866-463f-939d-2507ba302a3a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:38.231696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-76626fcb-4199-4b28-8021-bd54daeca07e req-2dcd942a-5866-463f-939d-2507ba302a3a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:38.250550 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-76626fcb-4199-4b28-8021-bd54daeca07e req-2dcd942a-5866-463f-939d-2507ba302a3a service nova] Creating event network-vif-deleted:9f544325-972f-4e60-9365-73a4114a5bfb for instance 53f72561-f391-43d4-8264-28016993a6a5 on hv-cinder-85236 Aug 09 16:56:38.256420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-76626fcb-4199-4b28-8021-bd54daeca07e req-2dcd942a-5866-463f-939d-2507ba302a3a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047787 Aug 09 16:56:38.257028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 358/747] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:38.262740 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c9346b01-9ed0-4165-a7c8-ec62639f4701 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096900 Aug 09 16:56:38.263359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 390/748] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:38 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:38.618404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:38.618999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:38.625886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:38.626366 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:38.626800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:38.628479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:38.628942 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:38.629364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:38.804098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:38.817055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-45f792a0-b5ee-4775-afbe-47f98c805607 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.202868 Aug 09 16:56:38.819609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 359/749] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:38 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:39.060090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:39.061597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:39.068939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.069563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.081939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:39.081939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.081939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.081939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:39.112904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.113403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.113922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:39.114406 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'fault' on Instance uuid 53f72561-f391-43d4-8264-28016993a6a5 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:39.162521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:39.171235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2d120694-ba38-4359-938b-45995bd9d756 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 200 len: 1335 microversion: 2.1 time: 0.119657 Aug 09 16:56:39.171750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 391/750] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:39 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:39.275051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:39.277328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:39.283846 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.284337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.284770 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:39.285469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.285923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.286341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:39.318059 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-81cb57c4-20ae-479e-8711-620b282f272b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047248 Aug 09 16:56:39.318891 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 360/751] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:39 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:39.847810 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:39.848553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:39.856186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.856680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.857126 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:39.857860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:39.858400 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:39.858831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:40.005296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:40.013687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dc88319c-8654-4368-80e5-0f1118200bae tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.170175 Aug 09 16:56:40.014272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 392/752] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:39 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:40.194133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:40.195466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: 53f72561-f391-43d4-8264-28016993a6a5] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:40.202393 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:40.202881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:40.203354 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:40.204153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:40.204792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:40.205225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:40.219253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] HTTP exception thrown: Instance 53f72561-f391-43d4-8264-28016993a6a5 could not be found. Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Request method failure captured: Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 HTTP/1.1 Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBhL9d8qboR3QkFRwU49x9sFiLeAQIxSrdali_ha4_JPziN37oRsK0P3Dbu5Z-fUJm39DaHNnsc1cckSTFHvgqIJssbnKvrPv1ymyhFgGBMRNYummTkBkuYAq97vQ3hHctrBf0WnT_zV9XnubQ6dznK9ZyF3FEMmFbE23nXq14kuyc Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:56:40.221016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b681b90f2f074e8c8cfb11939edc7f72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}] Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: c4529e57de654b36b53662be0148834c Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 53f72561-f391-43d4-8264-28016993a6a5 could not be found. Aug 09 16:56:40.222365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '53f72561-f391-43d4-8264-28016993a6a5'} Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53f72561-f391-43d4-8264-28016993a6a5 could not be found. Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:56:40.223159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53f72561-f391-43d4-8264-28016993a6a5 could not be found. Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53f72561-f391-43d4-8264-28016993a6a5 could not be found. Aug 09 16:56:40.224413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:40.225555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Returning 404 to user: Instance 53f72561-f391-43d4-8264-28016993a6a5 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:56:40.225555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6f5a6f60-452f-40c9-8e0e-ffab6160db9a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5" status: 404 len: 111 microversion: 2.1 time: 0.033002 Aug 09 16:56:40.225555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 361/753] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:40 2022] GET /compute/v2.1/servers/53f72561-f391-43d4-8264-28016993a6a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:56:40.232721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ceead191-999c-4682-8451-ca080afd827c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '.version_select at 0x7fccc4c1a280>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:40.324080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ceead191-999c-4682-8451-ca080afd827c tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487632429" status: 202 len: 0 microversion: 2.1 time: 0.096543 Aug 09 16:56:40.324711 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 393/754] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 16:56:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487632429 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:56:40.330772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:40.333263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:40.339566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:40.340263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:40.340702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:40.341413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:40.341863 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:40.342286 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:40.372983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-279154fd-77c3-437a-a54a-3a1264794da2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046700 Aug 09 16:56:40.373750 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 362/755] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:40 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:41.035123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:41.035999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:41.042787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:41.043764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:41.044203 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:41.048530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:41.048530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:41.048530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:41.184819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:41.192824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-436d859d-b3ee-4738-9279-167c8b3aff43 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.161525 Aug 09 16:56:41.193676 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 394/756] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:41 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:41.385276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:41.388208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:41.394630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:41.395137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:41.395636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:41.396332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:41.399700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:41.399700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:41.426654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-00ad7fd9-f324-4425-8f95-45c07b1e31c4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045357 Aug 09 16:56:41.428510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 363/757] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:41 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:42.220410 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:42.220944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:42.227454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:42.227939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:42.228491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:42.229174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:42.230351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:42.230942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:42.367795 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:42.375656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-44198061-28d7-4d53-add7-722ab0705a50 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.159254 Aug 09 16:56:42.380639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 395/758] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:42 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:42.439215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:42.441582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:42.449078 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:42.449599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:42.450104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:42.450867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:42.451358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:42.451786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:42.495253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-48832d8f-eeb7-4e4c-abea-815610542458 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050401 Aug 09 16:56:42.495253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 364/759] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:42 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:43.300375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:43.302924 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:43.309123 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.309834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.310566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.311730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.312438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.313130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.353730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-b055fabb-a8b3-43a9-9358-68a205877c4c req-41f8ac92-74e3-4f0f-afa4-864edd27e4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2daaa8cc-0b52-422c-adaa-98f905bb869b", "name": "network-vif-plugged", "status": "completed", "tag": "de1305b9-b3fe-416b-8157-bf1c65b0aa2a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:43.365908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-b055fabb-a8b3-43a9-9358-68a205877c4c req-41f8ac92-74e3-4f0f-afa4-864edd27e4c5 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.366319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-b055fabb-a8b3-43a9-9358-68a205877c4c req-41f8ac92-74e3-4f0f-afa4-864edd27e4c5 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.366778 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-b055fabb-a8b3-43a9-9358-68a205877c4c req-41f8ac92-74e3-4f0f-afa4-864edd27e4c5 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.378689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-b055fabb-a8b3-43a9-9358-68a205877c4c req-41f8ac92-74e3-4f0f-afa4-864edd27e4c5 service nova] Creating event network-vif-plugged:de1305b9-b3fe-416b-8157-bf1c65b0aa2a for instance 2daaa8cc-0b52-422c-adaa-98f905bb869b on hv-cinder-85236 Aug 09 16:56:43.384022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-b055fabb-a8b3-43a9-9358-68a205877c4c req-41f8ac92-74e3-4f0f-afa4-864edd27e4c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174656 Aug 09 16:56:43.384624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 396/760] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:43.397458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:43.398171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:43.405747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.406232 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.406656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.407388 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.407839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.408258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.413153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Invalid volume: volume b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 is already attached to instances: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: POST /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments HTTP/1.1 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 74 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:56:43.415437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {"volumeAttachment": {"volumeId": "b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9"}} Aug 09 16:56:43.426208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Invalid volume: volume b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 is already attached to instances: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'server_id': 'ead4e2e4-484b-4150-81ce-4cfc1e9a1c06', 'body': {'volumeAttachment': {'volumeId': 'b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9'}}} Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 is already attached to instances: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:43.427367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 is already attached to instances: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:43.429178 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 is already attached to instances: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 400 to user: Invalid volume: volume b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 is already attached to instances: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-24498dc0-908b-4878-ab72-e876949ede8e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121067 Aug 09 16:56:43.431496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 365/761] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:56:43 2022] POST /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 16:56:43.489348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:43.489875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:43.496678 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.497166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.497605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.498331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.501291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.501291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.551900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:43.561667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4b740c7f-accb-4e92-af47-1e5d63bcd0f8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.168216 Aug 09 16:56:43.562264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 397/762] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:43 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:43.567617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:43.570398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:43.577512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.578001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.578436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.579187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.579656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.580090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.584930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'services' on Instance uuid ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:43.618242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6c50e0a9-0b49-4df6-994e-b64f456260d2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050696 Aug 09 16:56:43.618242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 398/763] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:43 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:43.767301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ed418e7b-f28e-4aee-8077-72b85dcb611d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments/b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9" status: 202 len: 0 microversion: 2.1 time: 0.281710 Aug 09 16:56:43.767892 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 366/764] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:56:43 2022] DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments/b7859fd0-b93b-4ea6-b6e4-44ff5b1f1ba9 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:56:43.776925 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:43.779429 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:43.785389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.785865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.786295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.786980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.787465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.787886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.819422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e3a510ed-d8af-4adf-b2cc-6cb164217ba6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Aug 09 16:56:43.819986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 399/765] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:43 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:43.851596 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:43.852201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:43.859302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.859718 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.860148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.860828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:43.861275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:43.861695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:43.886881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:56:43.912893 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:44.185309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c29022fd-f3bf-41f9-894f-e0b3fabda422 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "DELETE /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 204 len: 0 microversion: 2.1 time: 0.337572 Aug 09 16:56:44.185922 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 367/766] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:56:43 2022] DELETE /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:56:44.194184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:44.194799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:44.201757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.202275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.202696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.203410 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.203863 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.204284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.206932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:44.337372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:44.345645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d72e858e-0152-47d1-be6b-42b20d830397 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1506 microversion: 2.1 time: 0.155638 Aug 09 16:56:44.346207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 400/767] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:44 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:44.584676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:44.585736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:44.592574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.593115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.593542 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.594238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.594685 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.595125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.627425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:44.629647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:44.638764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.639284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.639720 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.640622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.641079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.641648 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.673571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d80b57f0-ac11-42e7-87ff-62fef1e99680 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050080 Aug 09 16:56:44.674175 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 401/768] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:44 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:56:44.832788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:44.835062 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:44.841442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.841935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.842374 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.843091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:44.843566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:44.843997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:44.875050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a986923b-e75e-4480-ac6c-77b8a929e758 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 Aug 09 16:56:44.875649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 402/769] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:44 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:56:44.985694 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:44.993347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8be8ae5b-9b46-4adc-a08e-547cffcb6c65 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.413013 Aug 09 16:56:44.993916 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 368/770] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:44 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:45.366295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:45.366911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:45.374123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:45.374608 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:45.375049 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:45.375785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:45.376241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:45.376672 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:45.506083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:45.514723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5e21e24d-c4d0-4691-9d05-d68d36efc582 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1506 microversion: 2.1 time: 0.152216 Aug 09 16:56:45.515305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 403/771] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:45 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:45.687413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:45.689656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:45.696792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:45.697276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:45.697712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:45.698406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:45.698862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:45.699325 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:45.730191 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-85eeada5-ea39-4132-951c-12efc8b8470a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046991 Aug 09 16:56:45.730781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 369/772] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:45 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:45.887912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:45.890061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:45.895858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:45.896332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:45.896767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:45.897443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:45.897890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:45.898309 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:45.927486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3350bca5-d3dc-4a92-b345-ea71bfe67918 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Aug 09 16:56:45.928038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 404/773] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:45 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:46.014745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:46.015468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:46.021270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.021745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.022174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.022854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.023329 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.023750 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.161183 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:46.170156 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-469339b7-5244-4770-bd0a-96a1b5bc7514 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.159570 Aug 09 16:56:46.170732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 370/774] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:46 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:46.535542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:46.536147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:46.543537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.544015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.544631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.545285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.545739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.546162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.681293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:46.689521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-890090de-f627-4e89-873a-bf3defb91645 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1506 microversion: 2.1 time: 0.157820 Aug 09 16:56:46.690235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 405/775] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:46 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:46.742705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:46.744883 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:46.751264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.751806 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.752243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.752928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.753383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.753807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.784050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0df4d2b1-c8c0-42c9-b421-090b4e164873 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045372 Aug 09 16:56:46.784616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 371/776] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:46 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:46.939661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:46.941818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:46.947918 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.948917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.949347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.950037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:46.950488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:46.950910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:46.981123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8461452b-b924-47df-9aa3-b81bb165652e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 Aug 09 16:56:46.981670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 406/777] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:46 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:47.190864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:47.191580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:47.199315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:47.199823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:47.200256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:47.200943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:47.201398 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:47.201841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:47.334430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:47.343341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5c064a33-ae4d-47f6-b21d-28d726214fd0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.156531 Aug 09 16:56:47.343927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 372/778] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:47 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:47.710464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:47.711007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:47.718575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:47.719070 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:47.719542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:47.720251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:47.720709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:47.721219 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:47.798384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:47.800915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:47.810803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:47.811660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:47.812356 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:47.813487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:47.814035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:47.814533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:47.846291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-84081147-0a54-4564-be21-39b40c26b62d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053112 Aug 09 16:56:47.847205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 373/779] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:47 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 16:56:47.860952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:47.868742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9f585f06-74d6-4e76-bcc0-1f9b02efe92d tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1506 microversion: 2.1 time: 0.162481 Aug 09 16:56:47.880533 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 407/780] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:47 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:47.993410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:47.996188 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:48.002098 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.003053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.003053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.003736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.004191 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.004619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.034748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-094ea40c-0fdd-42c4-a665-73bf95a79e5f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 09 16:56:48.035371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 374/781] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:47 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:48.364133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:48.364749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:48.371565 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.372052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.372485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.373471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.373931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.374357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.509901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:48.518389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-018bc8d3-e528-41e9-9cab-4fb7f89165c9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1265 microversion: 2.1 time: 0.158031 Aug 09 16:56:48.519299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 408/782] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:48 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:48.863563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:48.863563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:48.867072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.867578 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.868024 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.869288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.869750 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.870801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.899499 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:48.903816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-230bd4f0-0c8b-4cc4-ad44-5b2b160dec19 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045415 Aug 09 16:56:48.903960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:48.904076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 375/783] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:48 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:56:48.907030 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.907610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.908054 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:48.908789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:48.909251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:48.909681 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.046978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:49.048052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:49.049154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:49.055892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-04519eda-32f4-4737-9e71-a0ab676c1401 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1506 microversion: 2.1 time: 0.160274 Aug 09 16:56:49.057023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.057673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.058218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.059024 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.059649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.060283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.070130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 409/784] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:48 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:49.091061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-feeb81f1-9461-4e2d-8e3f-35900894dd03 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048764 Aug 09 16:56:49.092082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 376/785] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:49 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:49.532983 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-936ad38c-9b19-46d6-b47f-b720f288a931 req-185f6f99-3217-4df7-b51f-bf3720329e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad3d121-535f-4a16-b412-574cf5da50e9", "name": "network-vif-deleted", "tag": "ba04df11-96c3-4666-be53-8af43db1ed2d"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:49.544167 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:49.545206 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:49.555076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.562184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.562184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.562443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-936ad38c-9b19-46d6-b47f-b720f288a931 req-185f6f99-3217-4df7-b51f-bf3720329e0c service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.562564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.562564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.562564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.562815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-936ad38c-9b19-46d6-b47f-b720f288a931 req-185f6f99-3217-4df7-b51f-bf3720329e0c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.562815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-936ad38c-9b19-46d6-b47f-b720f288a931 req-185f6f99-3217-4df7-b51f-bf3720329e0c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.579192 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-936ad38c-9b19-46d6-b47f-b720f288a931 req-185f6f99-3217-4df7-b51f-bf3720329e0c service nova] Creating event network-vif-deleted:ba04df11-96c3-4666-be53-8af43db1ed2d for instance bad3d121-535f-4a16-b412-574cf5da50e9 on hv-cinder-85236 Aug 09 16:56:49.586370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-936ad38c-9b19-46d6-b47f-b720f288a931 req-185f6f99-3217-4df7-b51f-bf3720329e0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057127 Aug 09 16:56:49.586988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 410/786] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:49.710064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:49.718844 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-520da185-db75-4fdb-a57b-bacd216bba15 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1452 microversion: 2.1 time: 0.183237 Aug 09 16:56:49.719601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 377/787] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:49 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:56:49.740159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:49.740793 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:49.747878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.751433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.751433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.751433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.751433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.751787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.898321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:49.909566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-706dc49e-5bcc-47e9-b037-4e7fa41fc806 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1452 microversion: 2.1 time: 0.173494 Aug 09 16:56:49.910167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 411/788] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:49 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:49.912514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:49.915366 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:49.926090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.928381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.928836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:49.931333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:49.935438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:49.935962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.010992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b86afda7-698e-4df0-b99c-60a3b4ec0e1d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.102360 Aug 09 16:56:50.013397 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 378/789] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 16:56:49 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:50.076609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:50.080425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:50.083380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.083869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.084310 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.085002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.085458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.085902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.086910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:50.087444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:50.094268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.094761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.095268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.095956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.096414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.096879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.118471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.118952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.119416 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.120228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'fault' on Instance uuid bad3d121-535f-4a16-b412-574cf5da50e9 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:50.125864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:56:50.204978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:50.212698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6fd2bc36-0552-4aed-b46d-5dbec966cba5 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1311 microversion: 2.1 time: 0.140641 Aug 09 16:56:50.213968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 412/790] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:50 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:50.219776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:50.221825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:50.228169 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.229105 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.230226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.231143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.231764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.232190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.264294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2fcaa61f-28d1-44be-a5b1-8f4759eb6e47 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Aug 09 16:56:50.264885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 413/791] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:50 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:50.465094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6cc99ad0-8b9a-4ecf-902b-50fa4cf67485 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 204 len: 0 microversion: 2.20 time: 0.381752 Aug 09 16:56:50.469887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 379/792] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 16:56:50 2022] DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 16:56:50.477100 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:50.477831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:50.484360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.484972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.485497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.486615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:50.487297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:50.487825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:50.649283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:50.657874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:50.659398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:50.660563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9c7040df-b65b-4d5e-96b0-a1cd1ea55037 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.187375 Aug 09 16:56:50.661118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 414/793] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:50 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:51.236008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:51.236637 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:51.243261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.243746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.244182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.244872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.245327 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.245747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.276999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:51.278516 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.279009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.279482 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.279938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'fault' on Instance uuid bad3d121-535f-4a16-b412-574cf5da50e9 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:56:51.280482 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:51.283198 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:51.293789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.294291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.294986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.295741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.296203 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.296631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.342686 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:51.350345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5b3d1a7d-51bb-43b8-a8bc-3370ed3232cd tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077453 Aug 09 16:56:51.357639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 415/794] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:56:51 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 16:56:51.371396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4a8de6a6-62cc-4440-8664-f26a3366615b tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 200 len: 1311 microversion: 2.1 time: 0.128489 Aug 09 16:56:51.371396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 380/795] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:51 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:51.421970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:51.422462 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:51.430732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.430732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.430732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.431027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.431340 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.431763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.469692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:56:51.491724 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:51.687148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:51.688041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:51.694862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.695575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.696191 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.697082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.699180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.699816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.719090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:51.840792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:51.851227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:51.852191 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4411f124-36bc-4a6f-9189-41d7b845b678 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 204 len: 0 microversion: 2.1 time: 0.434409 Aug 09 16:56:51.852812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:51.852947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 416/796] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:56:51 2022] DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:56:51.854093 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7820389d-f898-4a77-9afd-122aa131644c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.173827 Aug 09 16:56:51.857842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 381/797] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:51 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:56:51.872407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:51.872407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:51.872407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.872407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.872836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:51.872836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:51.872836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:51.872836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.106300 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:52.118336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-02cf0392-6a45-401c-981f-26d1bfe397eb tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1681 microversion: 2.1 time: 0.260101 Aug 09 16:56:52.119280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 417/798] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:51 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:52.378948 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-4a290d30-2e4e-4e91-9656-70b39e4acc8a req-cec8c619-44bf-40a1-968f-4ea22f6756f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daaa8cc-0b52-422c-adaa-98f905bb869b", "tag": "de1305b9-b3fe-416b-8157-bf1c65b0aa2a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:52.391266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4a290d30-2e4e-4e91-9656-70b39e4acc8a req-cec8c619-44bf-40a1-968f-4ea22f6756f7 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.391749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4a290d30-2e4e-4e91-9656-70b39e4acc8a req-cec8c619-44bf-40a1-968f-4ea22f6756f7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.392426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4a290d30-2e4e-4e91-9656-70b39e4acc8a req-cec8c619-44bf-40a1-968f-4ea22f6756f7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.398571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:52.399315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: bad3d121-535f-4a16-b412-574cf5da50e9] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:52.404610 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-4a290d30-2e4e-4e91-9656-70b39e4acc8a req-cec8c619-44bf-40a1-968f-4ea22f6756f7 service nova] Creating event network-changed:de1305b9-b3fe-416b-8157-bf1c65b0aa2a for instance 2daaa8cc-0b52-422c-adaa-98f905bb869b on hv-cinder-85236 Aug 09 16:56:52.408720 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.409296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.409826 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.409943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-4a290d30-2e4e-4e91-9656-70b39e4acc8a req-cec8c619-44bf-40a1-968f-4ea22f6756f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Aug 09 16:56:52.410592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.410905 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 382/799] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:52.411456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.417207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.426969 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] HTTP exception thrown: Instance bad3d121-535f-4a16-b412-574cf5da50e9 could not be found. Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Request method failure captured: Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 HTTP/1.1 Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBhL9d8qboR3QkFRwU49x9sFiLeAQIxSrdali_ha4_JPziN37oRsK0P3Dbu5Z-fUJm39DaHNnsc1cckSTFHvgqIJssbnKvrPv1ymyhFgGBMRNYummTkBkuYAq97vQ3hHctrBf0WnT_zV9XnubQ6dznK9ZyF3FEMmFbE23nXq14kuyc Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:56:52.428706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b681b90f2f074e8c8cfb11939edc7f72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}] Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: c4529e57de654b36b53662be0148834c Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance bad3d121-535f-4a16-b412-574cf5da50e9 could not be found. Aug 09 16:56:52.430234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'bad3d121-535f-4a16-b412-574cf5da50e9'} Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad3d121-535f-4a16-b412-574cf5da50e9 could not be found. Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:56:52.431189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad3d121-535f-4a16-b412-574cf5da50e9 could not be found. Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad3d121-535f-4a16-b412-574cf5da50e9 could not be found. Aug 09 16:56:52.432606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:56:52.433742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Returning 404 to user: Instance bad3d121-535f-4a16-b412-574cf5da50e9 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:56:52.433742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9d278828-f787-4b12-a8a6-b03a469d8ad9 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9" status: 404 len: 111 microversion: 2.1 time: 0.035722 Aug 09 16:56:52.434747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 418/800] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:52 2022] GET /compute/v2.1/servers/bad3d121-535f-4a16-b412-574cf5da50e9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:56:52.440025 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:52.440598 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:52.447678 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.448733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.449906 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.450619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.451077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.457467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.487071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:56:52.802898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ecbf4390-9e2f-4d29-be73-bd73d2272d62 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 204 len: 0 microversion: 2.1 time: 0.366638 Aug 09 16:56:52.803535 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 383/801] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:56:52 2022] DELETE /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 16:56:52.811826 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:52.812441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:52.818657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.819467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.819938 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.820836 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.821324 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.821755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.887254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:52.889117 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:52.898652 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.899419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.900861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.903257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:52.904501 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:52.904959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:52.994589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:53.004716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-21e991ef-08ce-48e7-95ed-8a1291bc1b63 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.196602 Aug 09 16:56:53.018517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 419/802] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:52 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:53.098404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:53.107838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:53.115601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:53.116920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e73c91f2-9e51-4b64-a548-f39436206957 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.235243 Aug 09 16:56:53.127288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 384/803] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:52 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:53.146270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:53.146270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:53.155961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:53.156738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:53.157365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:53.158449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:53.159140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:53.159783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:53.312995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:53.321226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ea059efa-def7-4aed-a202-c48bf0a6455e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1681 microversion: 2.1 time: 0.183995 Aug 09 16:56:53.321897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 420/804] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:53 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:54.025800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:54.027359 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:54.034138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:54.034622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:54.035056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:54.035811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:54.036271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:54.036697 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:54.141523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:54.142153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:54.150363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:54.151808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:54.152729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:54.154102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:54.154791 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:54.155266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:54.233956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:54.252216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1488bde3-ed5d-49bd-a09c-c6737fb4de07 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.229343 Aug 09 16:56:54.253552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 385/805] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:54 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:54.304245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:54.311094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:54.312611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:54.313773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-815c30bc-f54f-4278-b411-09c069b928d1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.177168 Aug 09 16:56:54.314331 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 421/806] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:54 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:54.343401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:54.344019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:54.346092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:56:54.350756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:54.351268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:54.352211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:54.352903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:54.353361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:54.353782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:54.565032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:54.573920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-86d612bc-c47f-4dc0-b400-27c8a094e752 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1681 microversion: 2.1 time: 0.233792 Aug 09 16:56:54.574751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 386/807] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:54 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:55.201508 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-d44443a7-d63a-41be-9180-225dd1d0dc31 req-f91ef77b-e4bb-4933-ae46-e2c19ad8b01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "name": "network-vif-unplugged", "status": "completed", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:55.216753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d44443a7-d63a-41be-9180-225dd1d0dc31 req-f91ef77b-e4bb-4933-ae46-e2c19ad8b01b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.216753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d44443a7-d63a-41be-9180-225dd1d0dc31 req-f91ef77b-e4bb-4933-ae46-e2c19ad8b01b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.216753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d44443a7-d63a-41be-9180-225dd1d0dc31 req-f91ef77b-e4bb-4933-ae46-e2c19ad8b01b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.228084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-d44443a7-d63a-41be-9180-225dd1d0dc31 req-f91ef77b-e4bb-4933-ae46-e2c19ad8b01b service nova] Creating event network-vif-unplugged:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:56:55.234156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-d44443a7-d63a-41be-9180-225dd1d0dc31 req-f91ef77b-e4bb-4933-ae46-e2c19ad8b01b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036342 Aug 09 16:56:55.235222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 422/808] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:55.278590 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:55.283363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:55.292312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.292919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.293586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.294422 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.294976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.295522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.339409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:55.340293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:55.347687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.348547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.349208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.350126 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.350584 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.351226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.499169 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:55.514572 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7845f9a1-e11b-4289-9c4c-87a61dd120ec tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.238384 Aug 09 16:56:55.515690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 387/809] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:55 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:55.527540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:55.541556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:55.543470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:55.544870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e82435e2-ee20-4f7b-82db-81103a8f5af8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.210485 Aug 09 16:56:55.545571 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 423/810] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:55 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:55.596189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:55.596794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:55.602901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.603426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.603868 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.605176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:55.605820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:55.606242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:55.813541 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:55.821781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-492217cb-16db-493c-a70c-6521afc9d65b tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1681 microversion: 2.1 time: 0.229442 Aug 09 16:56:55.822543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 388/811] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:55 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:56.536381 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:56.537014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:56.544301 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:56.545044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:56.545657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:56.546545 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:56.546996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:56.547600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:56.570725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:56.571979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:56.578807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:56.579563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:56.580161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:56.581025 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:56.581635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:56.582222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:56.724704 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:56.736225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-05992cc6-3218-4993-a8c6-fb21a3157bfa tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.203669 Aug 09 16:56:56.736908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 424/812] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:56 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:56.844473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:56.845086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:56.851135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:56.851613 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:56.852051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:56.856873 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:56.856873 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:56.856873 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:56.996804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:57.004789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-93f3d658-8705-42c6-a80b-24fb1247e921 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1681 microversion: 2.1 time: 0.164098 Aug 09 16:56:57.005456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 425/813] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:56 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:57.250174 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-5bcd9b94-ea20-4019-9c2e-64b1171a64c7 req-6b704fb7-537e-4d08-864e-b4f8049e5322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead4e2e4-484b-4150-81ce-4cfc1e9a1c06", "name": "network-vif-unplugged", "status": "completed", "tag": "787d32ec-b8e9-4f96-acec-6fb00d0163dd"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:57.261708 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-5bcd9b94-ea20-4019-9c2e-64b1171a64c7 req-6b704fb7-537e-4d08-864e-b4f8049e5322 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:57.262252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-5bcd9b94-ea20-4019-9c2e-64b1171a64c7 req-6b704fb7-537e-4d08-864e-b4f8049e5322 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:57.262712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-5bcd9b94-ea20-4019-9c2e-64b1171a64c7 req-6b704fb7-537e-4d08-864e-b4f8049e5322 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:57.274544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-5bcd9b94-ea20-4019-9c2e-64b1171a64c7 req-6b704fb7-537e-4d08-864e-b4f8049e5322 service nova] Creating event network-vif-unplugged:787d32ec-b8e9-4f96-acec-6fb00d0163dd for instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 on hv-cinder-85236 Aug 09 16:56:57.280787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-5bcd9b94-ea20-4019-9c2e-64b1171a64c7 req-6b704fb7-537e-4d08-864e-b4f8049e5322 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034770 Aug 09 16:56:57.281400 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 426/814] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:56:57.300222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:57.309247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:57.311001 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:57.312402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ce66eef5-959d-45a9-88e2-df8961dc2ad4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.747549 Aug 09 16:56:57.313084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 389/815] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:56 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:57.758040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:57.758991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:57.765970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:57.766461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:57.766902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:57.767657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:57.768114 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:57.768727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:57.925004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:57.934563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ba15c82d-be6f-4c04-93fd-8f8095b70e01 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.181134 Aug 09 16:56:57.936364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 427/816] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:57 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:58.026903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:58.027734 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:58.034354 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:58.034843 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:58.035344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:58.036051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:58.036499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:58.036920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:58.340429 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:58.341377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:58.348221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:58.348733 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:58.352285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:58.352285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:58.352285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:58.352285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:58.525875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:58.535730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:58.537506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:58.538919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-950c0f06-6865-45a5-9874-f4fda5152c39 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1723 microversion: 2.20 time: 0.206581 Aug 09 16:56:58.539626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 428/817] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:58 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:58.761771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:58.770251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a82c53b4-ea49-4b57-bd13-d8f73fc1b9c1 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1681 microversion: 2.1 time: 0.748140 Aug 09 16:56:58.783234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 390/818] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:58 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1681 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:58.958342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:58.958342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:58.962968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:58.964148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:58.965176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:58.966122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:58.966586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:58.967019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:59.117930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:59.136784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7aa770f9-d3f4-48a6-8545-e3809fdc7ac1 tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1522 microversion: 2.1 time: 0.184952 Aug 09 16:56:59.150668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 429/819] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:58 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:56:59.273047 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-d3a4dea4-2f80-4907-b52b-e55a038e49c3 req-2f4c7410-c9b9-4b5b-b018-9384d90a9e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d48aed-6528-46cd-a11e-6899591a4a27", "name": "network-vif-deleted", "tag": "53a24594-3349-4f0d-b4fe-6c7d9baea3f2"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:56:59.283650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-d3a4dea4-2f80-4907-b52b-e55a038e49c3 req-2f4c7410-c9b9-4b5b-b018-9384d90a9e05 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:59.284130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-d3a4dea4-2f80-4907-b52b-e55a038e49c3 req-2f4c7410-c9b9-4b5b-b018-9384d90a9e05 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:59.284586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-d3a4dea4-2f80-4907-b52b-e55a038e49c3 req-2f4c7410-c9b9-4b5b-b018-9384d90a9e05 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:59.296470 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-d3a4dea4-2f80-4907-b52b-e55a038e49c3 req-2f4c7410-c9b9-4b5b-b018-9384d90a9e05 service nova] Creating event network-vif-deleted:53a24594-3349-4f0d-b4fe-6c7d9baea3f2 for instance a4d48aed-6528-46cd-a11e-6899591a4a27 on hv-cinder-85236 Aug 09 16:56:59.301631 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-d3a4dea4-2f80-4907-b52b-e55a038e49c3 req-2f4c7410-c9b9-4b5b-b018-9384d90a9e05 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Aug 09 16:56:59.302462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 391/820] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:56:59.563569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:59.564849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:59.571583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:59.572307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:59.574151 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:59.575219 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:59.575897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:59.576625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:59.675932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:59.696347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:59.699124 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:56:59.706864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0b6284c1-084e-4250-91a8-b8d6f71e17a4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1655 microversion: 2.20 time: 0.148187 Aug 09 16:56:59.725627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 430/821] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:56:59 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:56:59.795193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:56:59.795918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:56:59.802654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:59.803360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:59.803804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:56:59.804513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:56:59.805126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:56:59.805563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:00.169010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:00.169010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:00.170614 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:00.171213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:00.171714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:00.172492 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:00.173015 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:00.173507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:00.217471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:00.235837 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:00.238834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:00.239005 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0e306493-3ac9-4dd5-b89c-50c0bab56b1c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1613 microversion: 2.1 time: 0.447281 Aug 09 16:57:00.239228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:00.239324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 392/822] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:56:59 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1613 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:00.251409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lazy-loading 'fault' on Instance uuid a4d48aed-6528-46cd-a11e-6899591a4a27 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:57:00.331412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4529e57de654b36b53662be0148834c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b681b90f2f074e8c8cfb11939edc7f72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:00.354696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6f06689c-bdf1-49c9-95f1-895858be298f tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 200 len: 1312 microversion: 2.1 time: 0.195101 Aug 09 16:57:00.355671 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 431/823] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:00 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:00.731244 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:00.731923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:00.738777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:00.739308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:00.739752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:00.740458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:00.740921 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:00.741344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:00.830436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:00.863023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:00.871639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:00.877876 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-04fc175a-5b21-40c7-87ac-93aa382a02f6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1366 microversion: 2.20 time: 0.149781 Aug 09 16:57:00.882143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 393/824] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:00 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:01.263087 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:01.268011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:01.280504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.281162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.281710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.283779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.284640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.285309 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.317336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7f4d33-f0b3-4448-9f68-813a5aead47a", "name": "network-vif-deleted", "tag": "08bec462-ab8b-4fe8-88b8-287b611ed36a"}, {"server_uuid": "ead4e2e4-484b-4150-81ce-4cfc1e9a1c06", "name": "network-vif-deleted", "tag": "787d32ec-b8e9-4f96-acec-6fb00d0163dd"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:01.330955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.331538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.332149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.332616 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'fault' on Instance uuid ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:57:01.344182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.344681 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.345116 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.363866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] Creating event network-vif-deleted:08bec462-ab8b-4fe8-88b8-287b611ed36a for instance da7f4d33-f0b3-4448-9f68-813a5aead47a on hv-cinder-85236 Aug 09 16:57:01.364383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] Creating event network-vif-deleted:787d32ec-b8e9-4f96-acec-6fb00d0163dd for instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 on hv-cinder-85236 Aug 09 16:57:01.378408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-2844e85e-f592-41ce-b281-6655dbf2a842 req-79fc17aa-6e4e-4b10-a058-d138a74e65d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064758 Aug 09 16:57:01.379020 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 394/825] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:57:01.387456 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:01.388428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] [instance: a4d48aed-6528-46cd-a11e-6899591a4a27] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:01.394524 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:01.404132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.404252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.404675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.405582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.406195 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.406781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.409370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-eec38d39-5f43-43ce-a33a-3c722832704f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 200 len: 1331 microversion: 2.1 time: 0.150249 Aug 09 16:57:01.410206 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 432/826] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:01 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 1331 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:01.442928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] HTTP exception thrown: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 could not be found. Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Request method failure captured: Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 HTTP/1.1 Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBhL9d8qboR3QkFRwU49x9sFiLeAQIxSrdali_ha4_JPziN37oRsK0P3Dbu5Z-fUJm39DaHNnsc1cckSTFHvgqIJssbnKvrPv1ymyhFgGBMRNYummTkBkuYAq97vQ3hHctrBf0WnT_zV9XnubQ6dznK9ZyF3FEMmFbE23nXq14kuyc Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:57:01.445092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b681b90f2f074e8c8cfb11939edc7f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b681b90f2f074e8c8cfb11939edc7f72", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b681b90f2f074e8c8cfb11939edc7f72"}]}] Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: b681b90f2f074e8c8cfb11939edc7f72 Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1381187790 Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: c4529e57de654b36b53662be0148834c Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1381187790-project Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 could not be found. Aug 09 16:57:01.446674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'a4d48aed-6528-46cd-a11e-6899591a4a27'} Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 could not be found. Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:01.447696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 could not be found. Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 could not be found. Aug 09 16:57:01.449638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:01.452269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] Returning 404 to user: Instance a4d48aed-6528-46cd-a11e-6899591a4a27 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:01.452920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b9a51397-dec3-43bd-8aa6-99f5afde6d2a tempest-ServerRescueNegativeTestJSON-1381187790 tempest-ServerRescueNegativeTestJSON-1381187790-project] 10.222.0.59 "GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27" status: 404 len: 111 microversion: 2.1 time: 0.072587 Aug 09 16:57:01.455288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 395/827] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:01 2022] GET /compute/v2.1/servers/a4d48aed-6528-46cd-a11e-6899591a4a27 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:57:01.649401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:01.653164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:01.674937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.675710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.676162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.676907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.677427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.677865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.705168 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:01.732106 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bc823ba3-d319-4ced-b2ed-15a4b4f651cc tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/ips" status: 200 len: 146 microversion: 2.1 time: 0.092006 Aug 09 16:57:01.733809 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 433/828] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:57:01 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/ips => generated 146 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:01.906437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:01.907050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:01.925363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.925860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.934245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:01.938570 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:01.942273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:01.942832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:02.031966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:02.032854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:02.036149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:02.036149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lazy-loading 'fault' on Instance uuid da7f4d33-f0b3-4448-9f68-813a5aead47a {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:57:02.138513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:02.171045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:02.177512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:02.182037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-87796bcc-62f6-474e-8c19-4c1f87fb45e3 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 200 len: 1371 microversion: 2.20 time: 0.280793 Aug 09 16:57:02.184548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 396/829] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:01 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:57:02.439211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:02.441258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:02.450047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:02.450524 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:02.451189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:02.452271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:02.452726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:02.453153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:02.470167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 HTTP/1.1 Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:57:02.472122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:57:02.480668 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'ead4e2e4-484b-4150-81ce-4cfc1e9a1c06'} Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:02.481517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:57:02.483002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:02.484132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:02.484132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7907e1c2-8876-435d-ab65-44efb843e368 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 404 len: 111 microversion: 2.1 time: 0.042274 Aug 09 16:57:02.484132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 434/830] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:02 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:57:02.487566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a833b982-024b-41db-aae1-2bd376ef6150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '.version_select at 0x7fccc4b02160>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:02.589067 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a833b982-024b-41db-aae1-2bd376ef6150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204670184" status: 202 len: 0 microversion: 2.1 time: 0.105452 Aug 09 16:57:02.590065 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 397/831] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 16:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204670184 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:57:03.214595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:03.215656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:03.222674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:03.223369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:03.223993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:03.224698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:03.225145 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:03.225725 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:03.246587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] HTTP exception thrown: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Request method failure captured: Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a HTTP/1.1 Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pDGfqaVHhn4nROlGEjulu0u-Y9HPehygGZ2X3vbBrN5hPFMFi_fRIvIGr-3fihY0Ib1IQaResdNvKoMhYm-M-DvvQBTHa_xml4zcYMBV-QgHmD2RvSRLG7zwFJXkYpMcFhEFebc13WUldNVpRXMRR4Sh7vKwPDUfLcciBA02z996gI Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:57:03.261458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_432f91c6e89c4fecb0d1f6afb1bcfe7e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}] Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 35d14469e54946bdb18bafbbed738f37 Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 16:57:03.263548 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'da7f4d33-f0b3-4448-9f68-813a5aead47a'} Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:03.264397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 16:57:03.265583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:03.266721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Returning 404 to user: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:03.266721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e34bb5dc-19d2-4b5f-8db1-1337dac87d1c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 404 len: 111 microversion: 2.20 time: 0.053056 Aug 09 16:57:03.266721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 435/832] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:03 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 16:57:03.273558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-344f4e00-1e40-473b-8c05-d43a064b3fa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '.version_select at 0x7fccc4b34040>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:03.388577 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-344f4e00-1e40-473b-8c05-d43a064b3fa2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183100428" status: 204 len: 0 microversion: 2.20 time: 0.119360 Aug 09 16:57:03.389484 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 398/833] 10.222.0.59 () {60 vars in 1262 bytes} [Tue Aug 9 16:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183100428 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 16:57:03.693503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10df73a8-f65e-42b4-b3ff-8cd9c0698a67"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:03.699142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:03.707819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:03.709055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:03.709665 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:03.711124 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:03.712709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:03.713141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:03.719472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0eafa2d8-4853-4c72-b32c-1664f77074ca tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: .version_select at 0x7fccc4b34a60>, body: {"keypair": {"name": "tempest-keypair-1224310522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Ed41npxEXgpIsrVlmQRfOaNwkHUCyPxX2txUtn+leD8Cy2q/KpcHdH41gcLKqyDrufXlCrCPrWo43q5x3+xBOW3QDeUcSM1ujO+LrkBc7mu99gqaYRAzhkbKO/C5qiw=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:03.740387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-0eafa2d8-4853-4c72-b32c-1664f77074ca tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:57:03.746022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-0eafa2d8-4853-4c72-b32c-1664f77074ca tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:57:03.894836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0eafa2d8-4853-4c72-b32c-1664f77074ca tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.181183 Aug 09 16:57:03.903377 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 399/834] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:57:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:57:04.812797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bd466856-be87-40c1-a418-b96938b71a0b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.125828 Aug 09 16:57:04.814088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 436/835] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:57:03 2022] POST /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:05.392395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2fe8b6d2-fb58-4eb4-a7f6-1b393b0e538f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'create', calling method: .version_select at 0x7fccc4b6f550>, body: {"keypair": {"name": "tempest-keypair-637665454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcwIXtKDRcmLhKXynmay2mGFT3+gutYGaVYvXYZL4SH0PaocfkWQt7pAuW/R+OIUW5CtRiWmtcinzilTrjYlltVWvAhcBuqsLXvgMmD+5BpzkNfGj9u0W0jyLsUUbYVYA=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:05.419751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-2fe8b6d2-fb58-4eb4-a7f6-1b393b0e538f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:57:05.419751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-2fe8b6d2-fb58-4eb4-a7f6-1b393b0e538f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for user 35d14469e54946bdb18bafbbed738f37 and project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:57:05.648499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2fe8b6d2-fb58-4eb4-a7f6-1b393b0e538f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.258956 Aug 09 16:57:05.649612 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 400/836] 10.222.0.59 () {62 vars in 1200 bytes} [Tue Aug 9 16:57:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 265 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 16:57:08.445949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162947747", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d512bb64-4fdf-40f1-b457-d57f69ae1831"}], "security_groups": [{"name": "tempest-securitygroup--1668936989"}], "key_name": "tempest-keypair-1224310522", "user_data": "}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:08.625056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] validate_networks() for [('d512bb64-4fdf-40f1-b457-d57f69ae1831', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:57:09.005599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1008507120", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2fdb2410-afc4-41b9-b8f9-2ac596eb2296"}], "security_groups": [{"name": "tempest-securitygroup--1234014954"}], "key_name": "tempest-keypair-637665454", "user_data": "}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:09.109734 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:57:09.110159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:57:09.110639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:57:09.111052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:57:09.111495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:57:09.122170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:09.122706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:09.123289 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:09.124969 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:09.127414 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:09.128048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:09.161090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:57:09.165927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Getting quotas for user e895e683cb964e599e235378f31e1c9f and project 321de2c92d814e6ab1da13939153da87. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:57:09.179257 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:57:09.181834 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:57:09.215820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] validate_networks() for [('2fdb2410-afc4-41b9-b8f9-2ac596eb2296', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:57:09.331268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e43bc478-172c-4fc8-8fd9-58b5afbd0e90 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.894759 Aug 09 16:57:09.339691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 437/837] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:57:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 16:57:09.344889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6e29159e-e56f-4a91-aba6-2e2ba825640e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:09.345767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6e29159e-e56f-4a91-aba6-2e2ba825640e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:09.423286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6e29159e-e56f-4a91-aba6-2e2ba825640e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:09.431892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6e29159e-e56f-4a91-aba6-2e2ba825640e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1241 microversion: 2.1 time: 0.090863 Aug 09 16:57:09.433483 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 438/838] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:09 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:10.029313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:57:10.029799 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:57:10.030230 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:57:10.030676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:57:10.031180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:57:10.048330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:10.050345 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:10.052447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:10.053432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:10.054911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:10.056858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:10.083448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:57:10.093248 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Getting quotas for user 35d14469e54946bdb18bafbbed738f37 and project 432f91c6e89c4fecb0d1f6afb1bcfe7e. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:57:10.114446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:57:10.118536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:57:10.256324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-74a3e13f-0f0f-416e-96dc-11d44ed8c669 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.255880 Aug 09 16:57:10.257605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 401/839] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Aug 9 16:57:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 16:57:10.270103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b237633d-cd0e-4320-96bb-a5b579c7eec6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:10.271617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b237633d-cd0e-4320-96bb-a5b579c7eec6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:10.399637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b237633d-cd0e-4320-96bb-a5b579c7eec6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:10.409745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b237633d-cd0e-4320-96bb-a5b579c7eec6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:10.411967 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b237633d-cd0e-4320-96bb-a5b579c7eec6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:10.413467 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b237633d-cd0e-4320-96bb-a5b579c7eec6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1281 microversion: 2.20 time: 0.148861 Aug 09 16:57:10.424463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 439/840] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:10 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:10.468747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:10.470073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:10.477918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:10.478751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:10.479890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:10.480761 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:10.481373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:10.482054 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:10.593772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:10.606149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3fb26e8b-5850-4fbd-a98f-c31fe0e39098 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1245 microversion: 2.1 time: 0.154709 Aug 09 16:57:10.608066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 402/841] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:10 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1245 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:11.442542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:11.448733 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:11.461527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:11.467598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:11.471048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:11.472632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:11.473460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:11.477783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:11.584750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:11.599298 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:11.601138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:11.603499 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-303f50d8-f3bb-44f0-8987-2bf8400f1f34 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1285 microversion: 2.20 time: 0.167345 Aug 09 16:57:11.606368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 440/842] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:11 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:11.637486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:11.638215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:11.647944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:11.648548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:11.649510 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:11.650563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:11.651823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:11.652508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:11.677014 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:11.757966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:11.769171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b7243977-c108-47f6-ad8d-c79fcd6e8f05 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1293 microversion: 2.1 time: 0.140881 Aug 09 16:57:11.769756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 403/843] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:11 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:12.630060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:12.630756 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:12.639721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:12.644632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:12.644632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:12.644632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:12.644632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:12.645055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:12.753472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:12.763346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:12.765084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:12.766532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-568bf2c4-e47a-4563-b101-2fb620c29c6d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1277 microversion: 2.20 time: 0.141630 Aug 09 16:57:12.767728 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 441/844] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:12 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1277 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:12.792857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:12.794335 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:12.803164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:12.803746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:12.804261 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:12.805069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:12.805601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:12.806209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:12.890299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:12.900272 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-48ba6a9c-5cb4-48ad-abea-d02c2ace472c tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1293 microversion: 2.1 time: 0.111790 Aug 09 16:57:12.900936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 404/845] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:12 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:13.802046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:13.803364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:13.817380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:13.818365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:13.824104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:13.826497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:13.827173 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:13.827792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:13.852536 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:13.856440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:13.867889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:13.868390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:13.868854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:13.870796 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:13.871364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:13.871979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:13.951308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:13.964476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:13.970974 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:13.970974 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c8ad487e-afc4-4232-958d-ac84ff913cba tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1341 microversion: 2.20 time: 0.169923 Aug 09 16:57:13.979901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 442/846] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:13 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:14.001093 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:14.004116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:14.019087 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:14.019913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:14.020575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:14.021494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:14.025119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:14.025659 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:14.026130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2bfb719c-367a-4b94-b7c8-b28118ede639 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180942 Aug 09 16:57:14.028792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 405/847] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:57:13 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:57:14.044473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:14.044987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:14.063495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:14.063908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:14.066134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:14.091551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:14.091551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:14.091551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:14.212303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-93e6d624-81a8-4488-b0c1-751f29d411ef tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/10df73a8-f65e-42b4-b3ff-8cd9c0698a67" status: 200 len: 194 microversion: 2.1 time: 0.168605 Aug 09 16:57:14.223659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 406/848] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 9 16:57:14 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/10df73a8-f65e-42b4-b3ff-8cd9c0698a67 => generated 194 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:14.265926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:14.279009 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-758eedd2-2c55-49ea-aa04-a77fce577d92 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1299 microversion: 2.1 time: 0.294148 Aug 09 16:57:14.281286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 443/849] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:13 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:14.993923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:14.994545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:15.012996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:15.016527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:15.017053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:15.017776 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:15.018236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:15.022442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:15.163687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:15.179389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:15.181018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:15.182243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fb232d55-25cc-4ebd-8e90-ac1caf87e908 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1339 microversion: 2.20 time: 0.192301 Aug 09 16:57:15.188385 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 407/850] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:14 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:15.303580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:15.304412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:15.316027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:15.317658 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:15.318341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:15.320285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:15.320934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:15.322095 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:15.669324 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:15.682880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e0b50da0-0058-4cda-a691-6fd5c8b80201 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.381523 Aug 09 16:57:15.684106 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 444/851] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:15 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:16.221267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a909385d-dbb6-4d12-8425-d5eea08c2631"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:16.224040 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:16.224673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:16.227578 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:16.242582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:16.246835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:16.247688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:16.248292 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:16.249179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:16.249803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:16.253946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:16.255136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:16.255604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:16.256345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:16.256803 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:16.257231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:16.388352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:16.422833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:16.424767 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:16.432999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c3446a7f-6d33-4f28-974a-7adda4c48134 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1339 microversion: 2.20 time: 0.220119 Aug 09 16:57:16.437266 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 408/852] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:16 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1339 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:16.712557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:16.716531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:16.743532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:16.743957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:16.744988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:16.745894 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:16.747712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:16.749029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:17.203731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:17.256428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-85784309-33a4-4a49-abff-b84a91f2fa39 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.548607 Aug 09 16:57:17.257419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 409/853] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:16 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:17.467607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:17.468213 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:17.473018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-29e5c97a-5956-4bc5-b4dc-4666bf714f18 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "POST /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.253505 Aug 09 16:57:17.474282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 445/854] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:57:16 2022] POST /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments => generated 194 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:17.486697 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:17.487737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:17.492243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:17.492243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:17.492243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:17.492243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:17.801719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-9ef2dfe6-c78f-4b2b-a692-739ab4961cd8 req-c46c69c2-8bbd-4997-b705-08e1d30500ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46922118-bf1a-420f-9f62-5ae8da9be3e3", "tag": "b3f31b42-fce1-423f-8902-589d9bd67308"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:17.827594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-9ef2dfe6-c78f-4b2b-a692-739ab4961cd8 req-c46c69c2-8bbd-4997-b705-08e1d30500ad service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:17.828382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-9ef2dfe6-c78f-4b2b-a692-739ab4961cd8 req-c46c69c2-8bbd-4997-b705-08e1d30500ad service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:17.829072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-9ef2dfe6-c78f-4b2b-a692-739ab4961cd8 req-c46c69c2-8bbd-4997-b705-08e1d30500ad service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:17.848070 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-9ef2dfe6-c78f-4b2b-a692-739ab4961cd8 req-c46c69c2-8bbd-4997-b705-08e1d30500ad service nova] Creating event network-changed:b3f31b42-fce1-423f-8902-589d9bd67308 for instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 on hv-cinder-85236 Aug 09 16:57:17.855428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-9ef2dfe6-c78f-4b2b-a692-739ab4961cd8 req-c46c69c2-8bbd-4997-b705-08e1d30500ad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059617 Aug 09 16:57:17.858131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 446/855] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:17.874177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:17.890911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:17.892968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:17.894014 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0d4dcf8e-3169-4408-b53b-9fe1f592c4e6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.433485 Aug 09 16:57:17.894663 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 410/856] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:17 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:18.296367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:18.308789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:18.321350 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:18.322418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:18.323323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:18.326869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:18.329242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:18.329949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:18.646807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:18.660783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e1e54903-90a3-498f-9545-00a6bf5f5800 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.381625 Aug 09 16:57:18.663404 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 447/857] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:18 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:18.918702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:18.919920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:18.927220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:18.928052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:18.928653 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:18.929620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:18.930241 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:18.930832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:19.249325 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:19.258130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:19.259715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:19.264223 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-91683884-0710-4cd5-9dff-2c1ba2151532 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.348243 Aug 09 16:57:19.265117 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 411/858] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:18 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:19.683523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:19.683523 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:19.685675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:19.692452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:19.692948 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:19.693384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:19.694091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:19.694805 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:19.695267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:19.844480 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:19.855129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-da772f8f-c057-4d46-a014-71e64c00b034 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.176593 Aug 09 16:57:19.858986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 448/859] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:19 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:19.878923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-5e25cd0b-51cb-4a56-8139-a4773ca73a86 req-6d559f38-ba92-4e0b-8ca8-61726f5117d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:19.893494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-5e25cd0b-51cb-4a56-8139-a4773ca73a86 req-6d559f38-ba92-4e0b-8ca8-61726f5117d3 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:19.894270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-5e25cd0b-51cb-4a56-8139-a4773ca73a86 req-6d559f38-ba92-4e0b-8ca8-61726f5117d3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:19.894702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-5e25cd0b-51cb-4a56-8139-a4773ca73a86 req-6d559f38-ba92-4e0b-8ca8-61726f5117d3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:19.908094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-5e25cd0b-51cb-4a56-8139-a4773ca73a86 req-6d559f38-ba92-4e0b-8ca8-61726f5117d3 service nova] Creating event network-changed:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 16:57:19.913742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-5e25cd0b-51cb-4a56-8139-a4773ca73a86 req-6d559f38-ba92-4e0b-8ca8-61726f5117d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038717 Aug 09 16:57:19.914352 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 412/860] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:20.295381 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:20.296002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:20.303596 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:20.304660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:20.305018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:20.305747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:20.306208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:20.306680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:20.407057 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=10 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:20.491675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:20.504066 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:20.516966 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:20.516966 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a0857350-d61f-4367-82ba-8bf606959472 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.218364 Aug 09 16:57:20.519923 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 449/861] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:20 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:20.879503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:20.880671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=14 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:20.884759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:20.886557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:20.893149 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:20.893771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:20.894353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:20.895221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:20.895778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:20.896413 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:21.072471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:21.081826 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7b5e10dd-effd-49ef-9ad3-31ccd027be16 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.203664 Aug 09 16:57:21.082656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 413/862] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:20 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:21.534009 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:21.534600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:21.537171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:21.542495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:21.543017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:21.543572 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:21.544275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:21.544777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:21.545419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:21.697755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:21.706507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:21.708096 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:21.709217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6aa7b272-218a-4e65-9325-6ea51d894b5d tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.179349 Aug 09 16:57:21.709780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 450/863] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:21 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:22.103625 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:22.105329 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:22.112380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:22.113215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:22.113833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:22.114695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:22.115331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:22.115933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:22.345680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:22.362490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-446d8b0f-3496-4a6a-ac6c-ae5278b77e0f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.262743 Aug 09 16:57:22.363085 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 414/864] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:22 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:22.735485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:22.738086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:22.746184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:22.747279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:22.747946 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:22.748890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:22.749439 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:22.750113 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:22.902762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:22.912028 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:22.913616 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:22.914740 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-00cfd790-4b2c-45d1-a063-2c1bd83b9365 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.184000 Aug 09 16:57:22.915339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 451/865] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:22 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:23.386702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:23.387364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:23.389973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:23.397141 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:23.403839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:23.403839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:23.403839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:23.403839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:23.404265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:23.575476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:23.585902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9c2669d7-82f9-407f-ba0b-1fedf6af4710 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.206996 Aug 09 16:57:23.586632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 415/866] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:23 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:24.164061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:24.164679 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:24.175027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:24.175360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:24.176061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:24.176776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:24.177285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:24.177682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:24.196069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:24.324558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:24.336534 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:24.338743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:24.340032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-45275a4d-fea7-4db7-9af2-d2feb339136e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.405373 Aug 09 16:57:24.340920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 452/867] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:23 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:24.606501 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:24.607085 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:24.613970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:24.614698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:24.615320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:24.616209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:24.616828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:24.617260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:24.778735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:24.787739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1237fa91-aca2-44fe-af5b-146c488ff532 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.185637 Aug 09 16:57:24.788405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 416/868] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:24 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:25.364704 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:25.365409 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:25.373506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:25.374034 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:25.374493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:25.375259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:25.375739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:25.376162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:25.520177 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:25.528457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:25.530194 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:25.531379 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5c3d6ba7-79ee-4643-93ce-6cfdd91867da tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.171342 Aug 09 16:57:25.531953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 453/869] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:25 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:25.809517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-86e8b80c-be8e-4b7e-9e7a-994ae41189e1 req-d9e6da3f-5b3a-4f06-9ddd-1ffca0c9bc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "name": "network-vif-plugged", "status": "completed", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:25.812275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:25.812942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:25.826916 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-86e8b80c-be8e-4b7e-9e7a-994ae41189e1 req-d9e6da3f-5b3a-4f06-9ddd-1ffca0c9bc17 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:25.827354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:25.827573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-86e8b80c-be8e-4b7e-9e7a-994ae41189e1 req-d9e6da3f-5b3a-4f06-9ddd-1ffca0c9bc17 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:25.827905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:25.828033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-86e8b80c-be8e-4b7e-9e7a-994ae41189e1 req-d9e6da3f-5b3a-4f06-9ddd-1ffca0c9bc17 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:25.828545 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:25.829881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:25.835148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:25.835148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.085551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-86e8b80c-be8e-4b7e-9e7a-994ae41189e1 req-d9e6da3f-5b3a-4f06-9ddd-1ffca0c9bc17 service nova] Creating event network-vif-plugged:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 16:57:26.089475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:26.099186 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-86e8b80c-be8e-4b7e-9e7a-994ae41189e1 req-d9e6da3f-5b3a-4f06-9ddd-1ffca0c9bc17 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291231 Aug 09 16:57:26.099186 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 417/870] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:26.105664 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1004cba1-e0d5-4bd7-8fa9-abf14a1d76b9 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.297082 Aug 09 16:57:26.107357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 454/871] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:25 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:26.461041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:26.462496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:26.471244 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.471746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.472207 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.472977 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.473444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.473874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.506595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9b53340d-1d5d-4396-bd6d-97b5875e2468 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053773 Aug 09 16:57:26.507513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 418/872] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:57:26 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:26.554439 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:26.555150 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:26.562715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.563238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.563683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.564393 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.564853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.565285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.658532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:26.661962 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:26.669175 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.669711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.670175 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.670864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.671353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.671783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.705124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9f2cb75d-ed48-437a-bb63-5404663e6618 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/10df73a8-f65e-42b4-b3ff-8cd9c0698a67" status: 200 len: 194 microversion: 2.1 time: 0.051245 Aug 09 16:57:26.705732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 419/873] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 9 16:57:26 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/10df73a8-f65e-42b4-b3ff-8cd9c0698a67 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:26.715938 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:26.720348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:26.720348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:26.724390 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:26.725910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.726404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.726535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:26.726978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.727641 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-37ea7f42-9b50-421e-a8b5-3f56f3b85ae9 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.177093 Aug 09 16:57:26.727752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:26.728151 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:26.728279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 455/874] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:26 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:57:26.728861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:26.750321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6ac8a06b-b886-4fe9-830a-3d332caa25ae tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Action: 'create', calling method: .version_select at 0x7fccc4b9a820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1215183523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJChn70q4zSsgyNx0ur0C9Rt8c431luDyvU+pxWy+YittU/aWV09ftuQKvoFkTCIuOvbzEnMtgLbTllPZW+49/VmS5JsXCYYD1oPdrdkzHZIiUEn/WkVzfFUfr/9+jmy4g=="}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:26.766375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-6ac8a06b-b886-4fe9-830a-3d332caa25ae tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Getting quotas for project 7ffda0edbe694650b9de23928f1de1a4. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:57:26.770582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-6ac8a06b-b886-4fe9-830a-3d332caa25ae tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Getting quotas for user b43cc0a86fed444daacd9194a0ad1a1b and project 7ffda0edbe694650b9de23928f1de1a4. Resources: {'key_pairs'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:57:26.813373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lazy-loading 'services' on Instance uuid 1229920f-1e1c-47ed-b793-477ffc82d0c7 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:57:26.867391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6ac8a06b-b886-4fe9-830a-3d332caa25ae tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.122888 Aug 09 16:57:26.868073 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 456/875] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 16:57:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:26.920963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:26.977263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1719512173", "imageRef": "abcb961b-313a-4c23-a46e-690b09c5d6f4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1215183523", "networks": [{"uuid": "3e93bc5e-1b39-45ff-a87b-06d2e09742f3"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:27.014682 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-38618baf-01f9-4cb9-961d-eeca95616472 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/10df73a8-f65e-42b4-b3ff-8cd9c0698a67" status: 202 len: 0 microversion: 2.1 time: 0.302237 Aug 09 16:57:27.018387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 420/876] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:57:26 2022] DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/10df73a8-f65e-42b4-b3ff-8cd9c0698a67 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:57:27.033619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] validate_networks() for [('3e93bc5e-1b39-45ff-a87b-06d2e09742f3', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:57:27.127227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:27.128003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:27.138828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:27.139366 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:27.139812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:27.140565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:27.141049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:27.141478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:27.296977 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:27.305342 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-84e022cc-6ac2-4e49-bb88-83825b4cd4a6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.182590 Aug 09 16:57:27.320139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 421/877] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:27 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:27.659439 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:57:27.659905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:57:27.660326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:57:27.660917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:57:27.661335 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:57:27.675292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:27.676355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:27.676355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:27.676903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:27.677376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:27.677778 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:27.695788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Getting quotas for project 7ffda0edbe694650b9de23928f1de1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:57:27.701829 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Getting quotas for user b43cc0a86fed444daacd9194a0ad1a1b and project 7ffda0edbe694650b9de23928f1de1a4. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:57:27.713071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:57:27.715599 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='abcb961b-313a-4c23-a46e-690b09c5d6f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:57:27.756550 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:27.757162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:27.763146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:27.763634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:27.764064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:27.764750 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:27.765203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:27.765630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:27.888142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b4750972-ec64-4b00-9386-bfb61fd933c2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.915129 Aug 09 16:57:27.888933 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 457/878] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 16:57:27.899692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5d7c83ea-446a-41a5-9eb6-162cb71cd44d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:27.900320 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5d7c83ea-446a-41a5-9eb6-162cb71cd44d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:27.905184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:27.915812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:27.918693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:27.919530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2b84036d-8b94-4d8e-ab38-fff89856a9ff tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1407 microversion: 2.20 time: 0.166807 Aug 09 16:57:27.920310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 422/879] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:27 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:57:27.960091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5d7c83ea-446a-41a5-9eb6-162cb71cd44d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:27.967463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5d7c83ea-446a-41a5-9eb6-162cb71cd44d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1259 microversion: 2.1 time: 0.071975 Aug 09 16:57:27.968076 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 458/880] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:27 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:28.113861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-488c8166-7a9c-44b3-9055-a0fd41705b73 req-4d64d9d3-6882-4454-8c58-8eb4805999d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46922118-bf1a-420f-9f62-5ae8da9be3e3", "name": "network-vif-plugged", "status": "completed", "tag": "b3f31b42-fce1-423f-8902-589d9bd67308"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:28.123872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-488c8166-7a9c-44b3-9055-a0fd41705b73 req-4d64d9d3-6882-4454-8c58-8eb4805999d7 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:28.124357 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-488c8166-7a9c-44b3-9055-a0fd41705b73 req-4d64d9d3-6882-4454-8c58-8eb4805999d7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:28.124792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-488c8166-7a9c-44b3-9055-a0fd41705b73 req-4d64d9d3-6882-4454-8c58-8eb4805999d7 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:28.147688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-488c8166-7a9c-44b3-9055-a0fd41705b73 req-4d64d9d3-6882-4454-8c58-8eb4805999d7 service nova] Creating event network-vif-plugged:b3f31b42-fce1-423f-8902-589d9bd67308 for instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 on hv-cinder-85236 Aug 09 16:57:28.152853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-488c8166-7a9c-44b3-9055-a0fd41705b73 req-4d64d9d3-6882-4454-8c58-8eb4805999d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042797 Aug 09 16:57:28.153452 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 423/881] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:57:28.328669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:28.329187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:28.335704 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:28.336183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:28.336960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:28.337670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:28.338497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:28.339510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:28.497936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:28.505824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ddd0cc08-3dc7-470b-8cff-3bb9dbf0b951 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.181104 Aug 09 16:57:28.506435 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 459/882] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:28 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:28.943614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:28.945142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:28.955385 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:28.955874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:28.957854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:28.957854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:28.957854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:28.957854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:28.988796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6189680e-a575-4415-b501-6e0fc80c355c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:28.992281 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6189680e-a575-4415-b501-6e0fc80c355c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:29.050645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6189680e-a575-4415-b501-6e0fc80c355c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:29.067535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6189680e-a575-4415-b501-6e0fc80c355c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1259 microversion: 2.1 time: 0.075592 Aug 09 16:57:29.067535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 460/883] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:28 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:29.105889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:29.114132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:29.115660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:29.116871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-49631b13-d6be-48f2-a808-447e32851e08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1599 microversion: 2.20 time: 0.178623 Aug 09 16:57:29.117451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 424/884] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:57:28 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:57:29.145125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:29.145527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:29.312448 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:29.312945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:29.313425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:29.314168 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:29.314621 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:29.315052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:29.398527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-12c90f10-c512-4d25-b2ca-000b890b05a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.257286 Aug 09 16:57:29.399196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 461/885] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Aug 9 16:57:29 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:57:29.527187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:29.527823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:29.533737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:29.534213 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:29.534768 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:29.535483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:29.536115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:29.536533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:29.678527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:29.686885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-46c09c02-5aa3-405d-8e05-f45c55ea1bd6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.163751 Aug 09 16:57:29.687520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 425/886] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:29 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:30.082184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:30.082819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:30.089444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.089997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.090581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.092165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.092678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.093115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.185247 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:30.192802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-75293cda-d3af-46af-b86a-de7f9f8c757d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1263 microversion: 2.1 time: 0.114849 Aug 09 16:57:30.193366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 462/887] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:30 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1263 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:30.266456 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:30.267034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:30.273593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.274106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.274548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.275277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.276379 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.276938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.311232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c5a042e5-34f3-448f-8164-172fb8d29742 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/a909385d-dbb6-4d12-8425-d5eea08c2631" status: 200 len: 194 microversion: 2.1 time: 0.048773 Aug 09 16:57:30.314657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 426/888] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 9 16:57:30 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/a909385d-dbb6-4d12-8425-d5eea08c2631 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:30.323266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:30.323768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:30.329835 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.330327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.330785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.331500 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.331968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.332680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.420159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lazy-loading 'services' on Instance uuid 1229920f-1e1c-47ed-b793-477ffc82d0c7 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:57:30.501705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-4989d842-d2da-472e-8472-131a3d995ebe req-5c1345df-7725-4564-ade3-43fe1101a7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:30.512258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4989d842-d2da-472e-8472-131a3d995ebe req-5c1345df-7725-4564-ade3-43fe1101a7b3 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.512746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4989d842-d2da-472e-8472-131a3d995ebe req-5c1345df-7725-4564-ade3-43fe1101a7b3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.513170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-4989d842-d2da-472e-8472-131a3d995ebe req-5c1345df-7725-4564-ade3-43fe1101a7b3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.530700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-4989d842-d2da-472e-8472-131a3d995ebe req-5c1345df-7725-4564-ade3-43fe1101a7b3 service nova] Creating event network-changed:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 16:57:30.536066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-4989d842-d2da-472e-8472-131a3d995ebe req-5c1345df-7725-4564-ade3-43fe1101a7b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037868 Aug 09 16:57:30.536777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 427/889] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:57:30.709945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:30.710573 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:30.718262 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.719315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.719723 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.720832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:30.721481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:30.721915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:30.755244 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fa5b7bc5-8252-4895-a16b-8ba8fd55ca7b tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/a909385d-dbb6-4d12-8425-d5eea08c2631" status: 202 len: 0 microversion: 2.1 time: 0.436228 Aug 09 16:57:30.755862 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 463/890] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:57:30 2022] DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments/a909385d-dbb6-4d12-8425-d5eea08c2631 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:57:30.910564 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:30.920136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-da0ef682-d608-4514-91fe-5541103505e3 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1367 microversion: 2.1 time: 0.214475 Aug 09 16:57:30.920741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 428/891] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:30 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:31.215459 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:31.217115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:31.229935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:31.232043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:31.232492 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:31.233215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:31.233674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:31.234156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:31.303248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:31.327158 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6cfa20ea-bb76-4ebd-b37f-3ca49a6fec81 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1255 microversion: 2.1 time: 0.116913 Aug 09 16:57:31.328038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 464/892] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:31 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1255 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:31.942177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:31.942727 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:31.949587 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:31.951963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:31.951963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:31.951963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:31.951963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:31.952308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:32.131774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:32.141772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d223970e-59f8-4ce0-b292-4f016f7b625d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1556 microversion: 2.1 time: 0.203597 Aug 09 16:57:32.142346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 429/893] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:31 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:32.164035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:32.164808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:32.170939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:32.171472 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:32.171920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:32.172629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:32.173087 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:32.173520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:32.254323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2602dc6f-b08c-447e-a346-396a0572abb8 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094116 Aug 09 16:57:32.255137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 465/894] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 9 16:57:32 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:32.349950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:32.350530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:32.356757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:32.357267 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:32.357710 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:32.358415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:32.358873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:32.359332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:32.448236 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:32.460640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-52a99f01-8203-45b3-b809-f06b2c096c6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1311 microversion: 2.1 time: 0.114455 Aug 09 16:57:32.461666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 430/895] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:32 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:33.315520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-da8cd1e7-7c79-4925-bf0c-6f9b6107f480 req-ee967b83-74ed-4281-8c2d-abff7b1330f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46922118-bf1a-420f-9f62-5ae8da9be3e3", "tag": "b3f31b42-fce1-423f-8902-589d9bd67308"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:33.344732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-da8cd1e7-7c79-4925-bf0c-6f9b6107f480 req-ee967b83-74ed-4281-8c2d-abff7b1330f2 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:33.345525 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-da8cd1e7-7c79-4925-bf0c-6f9b6107f480 req-ee967b83-74ed-4281-8c2d-abff7b1330f2 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:33.346848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-da8cd1e7-7c79-4925-bf0c-6f9b6107f480 req-ee967b83-74ed-4281-8c2d-abff7b1330f2 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:33.363396 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-da8cd1e7-7c79-4925-bf0c-6f9b6107f480 req-ee967b83-74ed-4281-8c2d-abff7b1330f2 service nova] Creating event network-changed:b3f31b42-fce1-423f-8902-589d9bd67308 for instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 on hv-cinder-85236 Aug 09 16:57:33.368474 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-da8cd1e7-7c79-4925-bf0c-6f9b6107f480 req-ee967b83-74ed-4281-8c2d-abff7b1330f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057115 Aug 09 16:57:33.369505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 466/896] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:33.481558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:33.482182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:33.494673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:33.495329 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:33.495816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:33.497349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:33.504045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:33.504506 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:33.872455 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:33.881309 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fe0a48d1-924d-412d-9825-f5fc7bb4ef7d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.404313 Aug 09 16:57:33.882986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 431/897] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:33 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:34.231682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:34.234888 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:34.244927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.246373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.246984 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.248068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.248684 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.249291 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.300760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1d44f769-edce-420d-94ce-13c35335eea2 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074173 Aug 09 16:57:34.310107 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 467/898] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:57:34 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 16:57:34.575368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:34.578306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:34.594119 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.595417 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.595885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.596635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.597093 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.601499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.656884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bc0c163a-bd17-4d8f-b598-b86fba2b2bd8 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088608 Aug 09 16:57:34.663849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 432/899] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:57:34 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 16:57:34.750332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:34.750332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:34.755121 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.755850 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.756604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.757544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.758232 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.758965 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.795347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:57:34.911234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:34.912364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:34.922620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.923562 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.925471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:34.932165 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:34.933295 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:34.933938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:35.105602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6b60c08b-587f-49a3-9559-434792c799ba tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 204 len: 0 microversion: 2.1 time: 0.361950 Aug 09 16:57:35.114184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 468/900] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:57:34 2022] DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:57:35.124643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:35.131992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:35.144730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:35.148010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:35.150017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:35.154133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:35.155223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:35.157509 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:35.196478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:35.214537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e474dee1-1ba2-4201-8254-07b3bd1bb4e4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.306964 Aug 09 16:57:35.215431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 433/901] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:34 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:35.329780 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:35.338776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4147eb38-1238-4e1f-b739-c3b047316005 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.221657 Aug 09 16:57:35.352283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 469/902] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:35 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:35.438890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-f2772d09-03b8-432a-a40c-b7f47958fdbe req-3ecc4379-4e88-4a11-b800-87658b768050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:35.449901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-f2772d09-03b8-432a-a40c-b7f47958fdbe req-3ecc4379-4e88-4a11-b800-87658b768050 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:35.450696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-f2772d09-03b8-432a-a40c-b7f47958fdbe req-3ecc4379-4e88-4a11-b800-87658b768050 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:35.451382 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-f2772d09-03b8-432a-a40c-b7f47958fdbe req-3ecc4379-4e88-4a11-b800-87658b768050 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:35.474605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-f2772d09-03b8-432a-a40c-b7f47958fdbe req-3ecc4379-4e88-4a11-b800-87658b768050 service nova] Creating event network-changed:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 16:57:35.487810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-f2772d09-03b8-432a-a40c-b7f47958fdbe req-3ecc4379-4e88-4a11-b800-87658b768050 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050908 Aug 09 16:57:35.488442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 434/903] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:36.240806 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:36.241537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:36.249152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:36.249742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:36.250288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:36.251183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:36.251733 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:36.252242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:36.361161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:36.361871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:36.368382 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:36.368871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:36.369304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:36.370778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:36.371394 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:36.371830 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:36.538170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:36.547838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e8bd2d8b-1c29-47d9-94ca-fc185a61edfd tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.191017 Aug 09 16:57:36.548959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 435/904] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:36 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:36.651666 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:36.659787 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-475eb2fb-344c-4f1d-a297-3529a764a62a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.423514 Aug 09 16:57:36.668465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 470/905] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:36 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:37.570679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:37.571441 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:37.580039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:37.580532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:37.580968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:37.581675 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:37.582137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:37.582563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:37.680299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:37.681486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:37.686149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:37.690160 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:37.690875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:37.691362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:37.692141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:37.692614 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:37.693216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:37.736706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:37.762391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-04b77ead-da40-4c33-8a91-8b334a120f72 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.183889 Aug 09 16:57:37.763426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 436/906] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:37 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:37.872052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:37.874425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:37.883769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f31e6bb0-c871-4e06-afa1-c819d89dcd2c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.207186 Aug 09 16:57:37.884449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 471/907] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:37 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:38.786313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:38.786935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:38.794489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:38.795270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:38.795865 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:38.796743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:38.797373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:38.797800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:38.906119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:38.907017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:38.914303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:38.914788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:38.915270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:38.915998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:38.917034 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:38.917463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:38.974378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:38.983965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9a990f4d-e3ef-4245-a84d-ad59057a93a4 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.201669 Aug 09 16:57:38.987066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 437/908] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:38 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:39.060339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=14 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:39.085090 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:39.093264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7f6c4048-9601-4a75-b85e-f76621eb49bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.191643 Aug 09 16:57:39.093945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 472/909] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:38 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:40.006654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:40.007956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:40.028478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:40.029328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:40.030096 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:40.031275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:40.032100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:40.033074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:40.121470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:40.122388 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:40.130903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:40.136426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:40.137197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:40.140061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:40.223367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:40.223367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:40.254951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:40.277656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bb7b2c45-9a8f-4bcc-8a74-222f41398292 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.275234 Aug 09 16:57:40.278285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 438/910] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:40 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:40.402575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:40.410393 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9d0c6ee0-d739-4d40-8a5e-d788f6a809d5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.297043 Aug 09 16:57:40.411347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 473/911] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:40 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:41.301741 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:41.305518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:41.316930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:41.318954 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:41.319833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:41.321183 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:41.322012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:41.323138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:41.366272 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:41.435238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:41.436901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:41.451764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:41.452897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:41.454040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:41.454944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:41.455594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:41.456200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:41.513543 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:41.523177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2cc255c5-8c33-44fe-879d-f348012026df tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.226766 Aug 09 16:57:41.524584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 439/912] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:41 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:41.681415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:41.692598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-175c91fe-682f-4537-aca0-bc92076cf3fc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.263238 Aug 09 16:57:41.694131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 474/913] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:41 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:42.545959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:42.546695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:42.553524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:42.554035 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:42.554477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:42.555207 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:42.555669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:42.556104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:42.714829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:42.715485 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:42.716252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:42.723428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c806a808-066b-4c9f-9b4f-3f2a06de2118 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.181358 Aug 09 16:57:42.723962 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:42.724095 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 440/914] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:42 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:42.724711 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:42.725316 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:42.726552 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:42.727184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:42.727776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:42.900786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:42.908681 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e9c0dc4c-d655-477d-adac-1e94ca4d2239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.197665 Aug 09 16:57:42.909248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 475/915] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:42 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:43.745947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:43.746643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:43.754527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:43.757326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:43.757326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:43.757326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:43.757326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:43.757717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:43.930488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:43.931351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:43.938059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:43.938551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:43.942758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:43.942758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:43.942758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:43.942758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:43.943547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:43.951830 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cc898e5d-3ec9-4259-9f93-e3ad9331a004 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.209733 Aug 09 16:57:43.952489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 441/916] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:43 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:44.080949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:44.089454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5561d105-bd5a-43fa-ac5a-8608b318e43c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.162690 Aug 09 16:57:44.089928 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 476/917] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:43 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:44.972524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:44.976936 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:44.979967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:44.980447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:44.980879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:44.981593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:44.982043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:44.982515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:45.118059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:45.120475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:45.125443 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:45.128072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:45.128942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:45.129634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:45.130097 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8eda0c81-6c2b-426d-9be8-116a1d53891a tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.161352 Aug 09 16:57:45.130573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:45.130851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 442/918] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:44 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:45.131245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:45.131739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:45.269033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:45.277820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-46412d90-b872-4ed3-bd1d-f0b3c28fb6ea tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.171132 Aug 09 16:57:45.278003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 477/919] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:45 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:46.152100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:46.152731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:46.159138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:46.159642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:46.160132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:46.160851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:46.161312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:46.161797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:46.304969 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:46.309159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:46.310504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:46.313744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1800d17d-772f-4d6e-9082-04e3c5364a71 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1673 microversion: 2.1 time: 0.165509 Aug 09 16:57:46.314407 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 443/920] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:46 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:46.323489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:46.323489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:46.323489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:46.323489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:46.323887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:46.323887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:46.474943 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:46.483334 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-86cbbfbd-18c0-4dc5-b01b-4f845cf4251c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.179254 Aug 09 16:57:46.483909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 478/921] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:46 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:47.337652 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:47.339044 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:47.346022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:47.346611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:47.347157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:47.348011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:47.348686 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:47.349212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:47.505100 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:47.505831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:47.513900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:47.514483 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:47.514919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:47.515661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:47.516715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:47.517136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:47.636490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:47.647605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8a81b9f5-c162-4ecc-bee3-b0bf741e4794 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1606 microversion: 2.1 time: 0.313867 Aug 09 16:57:47.648458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 444/922] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:47 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1606 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:47.667501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:47.675240 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8dfd223d-04c5-486e-af30-573fb8847d39 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.174362 Aug 09 16:57:47.675824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 479/923] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:47 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:48.026948 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-45d442cf-324f-428c-a63b-36a323ebb814 req-e9b3ed02-f719-442f-ae1e-211fabb7560e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1229920f-1e1c-47ed-b793-477ffc82d0c7", "name": "network-vif-deleted", "tag": "9cab5e90-f175-4329-b086-0861ea05f1e3"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:48.036530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-45d442cf-324f-428c-a63b-36a323ebb814 req-e9b3ed02-f719-442f-ae1e-211fabb7560e service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:48.037042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-45d442cf-324f-428c-a63b-36a323ebb814 req-e9b3ed02-f719-442f-ae1e-211fabb7560e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:48.037479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-45d442cf-324f-428c-a63b-36a323ebb814 req-e9b3ed02-f719-442f-ae1e-211fabb7560e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:48.049934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-45d442cf-324f-428c-a63b-36a323ebb814 req-e9b3ed02-f719-442f-ae1e-211fabb7560e service nova] Creating event network-vif-deleted:9cab5e90-f175-4329-b086-0861ea05f1e3 for instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 on hv-cinder-85236 Aug 09 16:57:48.055983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-45d442cf-324f-428c-a63b-36a323ebb814 req-e9b3ed02-f719-442f-ae1e-211fabb7560e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Aug 09 16:57:48.060198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 445/924] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:48.670146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:48.670852 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:48.677793 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:48.678489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:48.678925 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:48.679649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:48.680105 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:48.680522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:48.699328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:48.700102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:48.706692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:48.707511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:48.708139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:48.709033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:48.709670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:48.710272 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:48.752202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:48.761839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9a86a135-cecb-4817-8875-278ebc6b95b1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1606 microversion: 2.1 time: 0.096493 Aug 09 16:57:48.762793 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 480/925] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:48 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:48.849996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:48.858453 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-94c6ae79-0213-47bc-89fb-14f7b7016c2b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.164662 Aug 09 16:57:48.859042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 446/926] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:48 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:49.783763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:49.784421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:49.790639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:49.791141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:49.791816 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:49.792606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:49.793059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:49.793482 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:49.822140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:49.828105 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:49.828617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:49.829048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:49.829492 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lazy-loading 'fault' on Instance uuid 1229920f-1e1c-47ed-b793-477ffc82d0c7 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:57:49.872403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c0e3a34f13440b38fdf0ced22dc5a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54562f03aaae457ca88be251d2208e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:49.880110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:49.880654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8c6b4075-32b6-42f3-a242-71363d83c18e tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 200 len: 1327 microversion: 2.1 time: 0.100495 Aug 09 16:57:49.880918 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 481/927] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:49 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:49.881068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:49.889432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:49.890213 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:49.891700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:49.891939 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:49.892243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:49.892672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:50.030577 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:50.038021 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-689d796c-e5f3-4519-a0d7-7107d8de1548 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.161712 Aug 09 16:57:50.039843 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 447/928] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:49 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:50.903252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:50.903864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:50.910718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:50.911229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:50.911661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:50.912345 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:50.912794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:50.913222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:50.926986 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] HTTP exception thrown: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Request method failure captured: Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 HTTP/1.1 Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBbk8TUme3G-BGb-8at5esUYtUMmE61Ykdd3mLi5bOld12A0ChcYAi1YDNwpYS8wfHtI-oFBJRzOSEtiK8BeGseFOlr6MFSp0D7qGb_O9eW-XXNvLKqUPJBwRbr8ZPZ19uDNYW2QgNcjCtAvzBJnO8lO7XwhUGOp8NHRdiHQ7b6eQw Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:57:50.928627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_54562f03aaae457ca88be251d2208e2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}] Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 7c0e3a34f13440b38fdf0ced22dc5a01 Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:50.930237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '1229920f-1e1c-47ed-b793-477ffc82d0c7'} Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:50.931371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:50.933127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:50.934637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Returning 404 to user: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:50.934637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f0e8e5b5-9cd6-48c1-8941-1a1751e58cdf tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 404 len: 111 microversion: 2.1 time: 0.032138 Aug 09 16:57:50.934637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 482/929] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:50 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:57:50.939317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0c37a009-fc55-43aa-8254-9e3210e34185 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '.version_select at 0x7fccc4c409d0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:51.031354 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0c37a009-fc55-43aa-8254-9e3210e34185 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737823856" status: 202 len: 0 microversion: 2.1 time: 0.095767 Aug 09 16:57:51.031961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 448/930] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 16:57:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1737823856 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:57:51.058375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:51.058992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:51.065718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:51.066202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:51.066635 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:51.067366 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:51.067819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:51.068248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:51.243415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:51.252029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a7f1a818-6713-4353-a64a-0b736678e8db tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.198056 Aug 09 16:57:51.252600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 483/931] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:51 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:52.276275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:52.277004 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:52.283727 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:52.284214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:52.284716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:52.285411 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:52.285870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:52.286301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:52.417049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:52.424420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9ab0a1a4-53a8-4478-b3f5-2742d37a9552 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.153323 Aug 09 16:57:52.424979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 449/932] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:52 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:53.445505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:53.446910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:53.455950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:53.456458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:53.456953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:53.457660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:53.458363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:53.458972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:53.591845 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-521006a5-984f-4a23-9d20-377b83e84fee req-ee827888-0ff7-4aab-ad42-cda24d38755b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "name": "network-vif-plugged", "status": "completed", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:53.601013 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:53.603270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-521006a5-984f-4a23-9d20-377b83e84fee req-ee827888-0ff7-4aab-ad42-cda24d38755b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:53.603751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-521006a5-984f-4a23-9d20-377b83e84fee req-ee827888-0ff7-4aab-ad42-cda24d38755b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:53.604179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-521006a5-984f-4a23-9d20-377b83e84fee req-ee827888-0ff7-4aab-ad42-cda24d38755b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:53.617054 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-521006a5-984f-4a23-9d20-377b83e84fee req-ee827888-0ff7-4aab-ad42-cda24d38755b service nova] Creating event network-vif-plugged:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 16:57:53.623563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-521006a5-984f-4a23-9d20-377b83e84fee req-ee827888-0ff7-4aab-ad42-cda24d38755b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034902 Aug 09 16:57:53.625003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 450/933] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:57:53.628453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:53.637294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f398f145-5f56-45a2-a989-b8d82d2f5848 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.195966 Aug 09 16:57:53.638012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 484/934] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:53 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:54.604105 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:54.604691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:54.612182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:54.619553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:54.619553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:54.619553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:54.619553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:54.620068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:54.627957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] HTTP exception thrown: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Request method failure captured: Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 HTTP/1.1 Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBbk8TUme3G-BGb-8at5esUYtUMmE61Ykdd3mLi5bOld12A0ChcYAi1YDNwpYS8wfHtI-oFBJRzOSEtiK8BeGseFOlr6MFSp0D7qGb_O9eW-XXNvLKqUPJBwRbr8ZPZ19uDNYW2QgNcjCtAvzBJnO8lO7XwhUGOp8NHRdiHQ7b6eQw Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:57:54.629580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_54562f03aaae457ca88be251d2208e2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}] Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 7c0e3a34f13440b38fdf0ced22dc5a01 Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.631176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '1229920f-1e1c-47ed-b793-477ffc82d0c7'} Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:54.632011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.633182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.634777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Returning 404 to user: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:54.634777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-52458142-683e-45d2-bc65-5a0132e6d115 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 404 len: 111 microversion: 2.1 time: 0.031158 Aug 09 16:57:54.634777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 451/935] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:57:54 2022] DELETE /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:57:54.641047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:54.650430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: 1229920f-1e1c-47ed-b793-477ffc82d0c7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:54.650430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:54.650430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:54.650430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:54.650798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:54.650798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:54.650798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:54.658265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:54.658875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:54.664610 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:54.665087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:54.665296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] HTTP exception thrown: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.665517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:54.666196 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:54.666643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Request method failure captured: Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 HTTP/1.1 Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBbk8TUme3G-BGb-8at5esUYtUMmE61Ykdd3mLi5bOld12A0ChcYAi1YDNwpYS8wfHtI-oFBJRzOSEtiK8BeGseFOlr6MFSp0D7qGb_O9eW-XXNvLKqUPJBwRbr8ZPZ19uDNYW2QgNcjCtAvzBJnO8lO7XwhUGOp8NHRdiHQ7b6eQw Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:57:54.666825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_54562f03aaae457ca88be251d2208e2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}] Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 7c0e3a34f13440b38fdf0ced22dc5a01 Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.668567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '1229920f-1e1c-47ed-b793-477ffc82d0c7'} Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:54.669355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. Aug 09 16:57:54.670629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:57:54.674264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:54.674802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Returning 404 to user: Instance 1229920f-1e1c-47ed-b793-477ffc82d0c7 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:54.674802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1deab411-d1d0-49a9-ad64-e623c882ae2d tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 09 16:57:54.674802 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 485/936] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:54 2022] GET /compute/v2.1/servers/1229920f-1e1c-47ed-b793-477ffc82d0c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:57:54.807405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:54.815177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-454f28fe-2ea9-40f9-b35a-a2f9de079294 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1359 microversion: 2.1 time: 0.160631 Aug 09 16:57:54.815737 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 452/937] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:54 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:55.837268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:55.837889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:55.846088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:55.846588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:55.851394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:55.851394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:55.851394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:55.851394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:55.955472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:55.955472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:55.961985 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:55.962733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:55.963289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:55.967617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:55.968693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:55.969623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:55.986559 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] HTTP exception thrown: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Request method failure captured: Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 HTTP/1.1 Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBbk8TUme3G-BGb-8at5esUYtUMmE61Ykdd3mLi5bOld12A0ChcYAi1YDNwpYS8wfHtI-oFBJRzOSEtiK8BeGseFOlr6MFSp0D7qGb_O9eW-XXNvLKqUPJBwRbr8ZPZ19uDNYW2QgNcjCtAvzBJnO8lO7XwhUGOp8NHRdiHQ7b6eQw Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:57:55.988257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_54562f03aaae457ca88be251d2208e2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}] Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 7c0e3a34f13440b38fdf0ced22dc5a01 Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:55.989816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'e7a274d0-9d37-4f6f-8a7e-2f223cf42198'} Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:55.990696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:55.992173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:55.993839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Returning 404 to user: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:55.993839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d3ac7385-b3bb-48cd-9cc4-aaaf29abdad1 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 404 len: 111 microversion: 2.1 time: 0.042551 Aug 09 16:57:55.997037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 453/938] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:57:55 2022] DELETE /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:57:56.001978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:56.002683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] [instance: e7a274d0-9d37-4f6f-8a7e-2f223cf42198] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:56.008625 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.012111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.012111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.012111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.012111 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.012609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.025713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] HTTP exception thrown: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Request method failure captured: Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 HTTP/1.1 Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBbk8TUme3G-BGb-8at5esUYtUMmE61Ykdd3mLi5bOld12A0ChcYAi1YDNwpYS8wfHtI-oFBJRzOSEtiK8BeGseFOlr6MFSp0D7qGb_O9eW-XXNvLKqUPJBwRbr8ZPZ19uDNYW2QgNcjCtAvzBJnO8lO7XwhUGOp8NHRdiHQ7b6eQw Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:57:56.028583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/54562f03aaae457ca88be251d2208e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_54562f03aaae457ca88be251d2208e2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/54562f03aaae457ca88be251d2208e2e"}]}] Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 54562f03aaae457ca88be251d2208e2e Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeTestJSON-257506351 Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 7c0e3a34f13440b38fdf0ced22dc5a01 Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeTestJSON-257506351-project Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:56.035451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'e7a274d0-9d37-4f6f-8a7e-2f223cf42198'} Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:57:56.036476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. Aug 09 16:57:56.037818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:57:56.039868 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] Returning 404 to user: Instance e7a274d0-9d37-4f6f-8a7e-2f223cf42198 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:57:56.039868 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3ac2aec9-e942-4a5d-99f4-3ed6441a7207 tempest-AttachVolumeTestJSON-257506351 tempest-AttachVolumeTestJSON-257506351-project] 10.222.0.59 "GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198" status: 404 len: 111 microversion: 2.1 time: 0.031852 Aug 09 16:57:56.039868 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 454/939] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:55 2022] GET /compute/v2.1/servers/e7a274d0-9d37-4f6f-8a7e-2f223cf42198 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:57:56.046087 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:56.056872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9bc44220-f9d0-4115-a91c-f7c6fd75cc42 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1549 microversion: 2.1 time: 0.224439 Aug 09 16:57:56.059037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 486/940] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:55 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1549 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:57:56.081672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:56.081933 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:56.087966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.088765 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.090500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.090779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.091283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.091718 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.246343 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:56.258554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-637c967b-387e-474a-9917-3cb9472c8ee7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1549 microversion: 2.1 time: 0.181184 Aug 09 16:57:56.261843 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 455/941] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:56 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:56.280453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:56.286146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:56.287252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Searching by: {'deleted': False, 'project_id': '7ffda0edbe694650b9de23928f1de1a4'} {{(pid=124900) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 16:57:56.297264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.297758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.298277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.299024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.302864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.302864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.395034 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.multi_cell_list [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124900) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 16:57:56.491541 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2f26ded7-e739-44aa-a670-7071f5a44697 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215485 Aug 09 16:57:56.492054 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 487/942] 10.222.0.59 () {58 vars in 1125 bytes} [Tue Aug 9 16:57:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:57:56.504249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:57:56.504870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:56.510764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.511856 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.512302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.513074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:56.513656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:56.513957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:56.754594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:57:56.762234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-59bedcaa-2b6e-40fd-bf0c-1edb87cd8e5d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1549 microversion: 2.1 time: 0.261825 Aug 09 16:57:56.763148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 456/943] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:57:56 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1549 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:57:58.704248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b4518f4-e731-4689-8bab-9fa40a28905f"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:57:58.707412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:57:58.716557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:58.717377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:58.718649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:58.719665 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:57:58.720476 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:57:58.721559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:57:58.988496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:57:59.690315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-95c5fb05-724c-41fb-9088-c4822a2a14ec tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992538 Aug 09 16:57:59.691520 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 488/944] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:57:58 2022] POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:01.522676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1411152370", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "networks": [{"uuid": "3ecd1e48-b208-40fa-9bc8-96d3528dd429"}]}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:01.577214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] validate_networks() for [('3ecd1e48-b208-40fa-9bc8-96d3528dd429', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:58:01.938223 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:58:01.938720 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:58:01.939225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:58:01.939668 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:58:01.940078 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:58:01.949862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:01.950341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:01.950774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:01.951532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:01.951986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:01.952408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:01.970214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Getting quotas for project 52db6dcf868e441b848d3a1dc2053080. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:58:01.976938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Getting quotas for user a1244c06dbc94fc48437ec6bc78261ec and project 52db6dcf868e441b848d3a1dc2053080. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:58:01.986063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:58:01.988372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:58:02.122374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0685b145-9dd2-4f64-a855-62852e3370f7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603589 Aug 09 16:58:02.123024 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 457/945] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 16:58:02.135249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c9cded77-6c18-4da5-b000-88866bb238cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:02.135956 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c9cded77-6c18-4da5-b000-88866bb238cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:02.207740 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c9cded77-6c18-4da5-b000-88866bb238cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:02.216016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c9cded77-6c18-4da5-b000-88866bb238cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1214 microversion: 2.1 time: 0.085609 Aug 09 16:58:02.216808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 489/946] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:02 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:02.624635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2cc1957b-b33d-4345-a91f-d6955701edbd tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Action: 'create', calling method: .version_select at 0x7fccc4b9ca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-559121682"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:03.237018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:03.237637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:03.244376 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:03.244863 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:03.245302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:03.246881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:03.247378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:03.247812 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:03.305711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2cc1957b-b33d-4345-a91f-d6955701edbd tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.801920 Aug 09 16:58:03.306252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 458/947] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Aug 9 16:58:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 803 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 16:58:03.316296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:03.319362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-336f156f-ee0a-499a-be44-ed9967204c73 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b02ca0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:03.325303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a7f3e4f3-2f54-4039-80c0-db6a38bbe4cc tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1218 microversion: 2.1 time: 0.092283 Aug 09 16:58:03.325881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 490/948] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:03 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:03.372063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-336f156f-ee0a-499a-be44-ed9967204c73 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 200 len: 344 microversion: 2.1 time: 0.056398 Aug 09 16:58:03.372724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 459/949] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:58:03 2022] GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:04.346515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:04.347053 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:04.353493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:04.353981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:04.354423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:04.355142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:04.355604 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:04.356035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:04.386244 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3eea005f-d338-4bd9-92c8-b0d39cdeb3d8 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b4ea60>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:04.420481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:04.428311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2914eb2c-1b7c-4b7b-82b4-98b56776ca8d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1266 microversion: 2.1 time: 0.085944 Aug 09 16:58:04.429000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 491/950] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:04 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:04.434458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3eea005f-d338-4bd9-92c8-b0d39cdeb3d8 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 200 len: 345 microversion: 2.1 time: 0.052288 Aug 09 16:58:04.435259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 460/951] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:58:04 2022] GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:04.447785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c7a700b4-0349-4b60-b17b-dfdd093db873 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Action: 'create', calling method: .version_select at 0x7fccc4c1a4c0>, body: {"snapshot": {"volume_id": "36c65eda-82c8-4b66-b3ea-1ee5147292c9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-586301390"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:05.021719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c7a700b4-0349-4b60-b17b-dfdd093db873 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.578008 Aug 09 16:58:05.022315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 492/952] 10.222.0.59 () {60 vars in 1162 bytes} [Tue Aug 9 16:58:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:05.034247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8cf62391-bdfc-4db7-98f9-825675e5da09 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b9c790>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:05.079125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8cf62391-bdfc-4db7-98f9-825675e5da09 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 286 microversion: 2.1 time: 0.047549 Aug 09 16:58:05.079877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 461/953] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:05 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:05.089116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-de7bfc91-ce15-4efd-8c18-3b13fdf741df tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b9a1f0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:05.121745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-de7bfc91-ce15-4efd-8c18-3b13fdf741df tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036244 Aug 09 16:58:05.122812 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 493/954] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Aug 9 16:58:05 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:05.133429 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cc88068e-b7ee-45ec-8ed6-927fa81a3298 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4c51040>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:05.166267 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cc88068e-b7ee-45ec-8ed6-927fa81a3298 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 286 microversion: 2.1 time: 0.036748 Aug 09 16:58:05.166835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 462/955] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:05 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:05.455152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:05.455152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:05.460932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:05.460932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:05.460932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:05.460932 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:05.462004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:05.462530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:05.597491 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:05.605359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-80c1bb04-3f41-4c6e-9906-f34fd14acbf6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.159144 Aug 09 16:58:05.605937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 494/956] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:05 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:06.180231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1c984c3a-bc3c-4525-8637-ad31300e9511 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b4ec10>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:06.211574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1c984c3a-bc3c-4525-8637-ad31300e9511 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 286 microversion: 2.1 time: 0.035781 Aug 09 16:58:06.212154 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 463/957] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:06 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:06.331931 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-7827556c-3f64-430a-8226-f20ea44b28ea req-742d9557-e7a1-4783-9fde-cbd457c9d87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7a0829-3182-4786-834f-fc42cca9ae3c", "tag": "90fc48d3-44e8-42b9-9e46-3bc83c4de9cb"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:06.336971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:06.343013 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7827556c-3f64-430a-8226-f20ea44b28ea req-742d9557-e7a1-4783-9fde-cbd457c9d87e service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:06.343518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7827556c-3f64-430a-8226-f20ea44b28ea req-742d9557-e7a1-4783-9fde-cbd457c9d87e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:06.343953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7827556c-3f64-430a-8226-f20ea44b28ea req-742d9557-e7a1-4783-9fde-cbd457c9d87e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:06.354776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-7827556c-3f64-430a-8226-f20ea44b28ea req-742d9557-e7a1-4783-9fde-cbd457c9d87e service nova] Creating event network-changed:90fc48d3-44e8-42b9-9e46-3bc83c4de9cb for instance eb7a0829-3182-4786-834f-fc42cca9ae3c on hv-cinder-85236 Aug 09 16:58:06.360801 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-7827556c-3f64-430a-8226-f20ea44b28ea req-742d9557-e7a1-4783-9fde-cbd457c9d87e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032559 Aug 09 16:58:06.361411 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 495/958] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:06.625811 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:06.626428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:06.632711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:06.633203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:06.633642 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:06.634346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:06.634803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:06.635263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:06.766980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:06.774461 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-59864954-3970-4d09-9edc-1db3178673cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.152623 Aug 09 16:58:06.775033 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 464/959] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:06 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:07.225584 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7e8bd61d-a9c2-4785-85e9-768003b721d5 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4d67ee0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:07.256908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7e8bd61d-a9c2-4785-85e9-768003b721d5 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 286 microversion: 2.1 time: 0.035874 Aug 09 16:58:07.257628 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 496/960] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:07 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:07.795389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:07.795958 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:07.802858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:07.803381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:07.803818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:07.804515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:07.805060 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:07.805517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:07.935508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:07.942901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d50f5f6c-a9a8-4997-8b4d-6500f965f9ff tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.151569 Aug 09 16:58:07.943509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 465/961] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:07 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:08.269087 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-56a3d537-eac9-4d85-908e-5578a08b8f3b tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b4a040>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:08.298951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-56a3d537-eac9-4d85-908e-5578a08b8f3b tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 286 microversion: 2.1 time: 0.034381 Aug 09 16:58:08.299568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 497/962] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:08 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:08.963282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:08.963903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:08.973016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:08.973016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:08.973016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:08.973016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:08.973914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:08.973914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:09.116175 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:09.123554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-43ef997c-950d-46ce-be97-9a41e9c11b3a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.164093 Aug 09 16:58:09.125217 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 466/963] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:08 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:09.313079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2154e813-9d19-46f2-ada8-7e1fb627e99f tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4d931f0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:09.345208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2154e813-9d19-46f2-ada8-7e1fb627e99f tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 287 microversion: 2.1 time: 0.038038 Aug 09 16:58:09.352314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 498/964] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:09 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:09.356909 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7569d216-6e8a-4d7a-9070-2d70ca52d06a tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b42430>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:09.490187 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7569d216-6e8a-4d7a-9070-2d70ca52d06a tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 202 len: 0 microversion: 2.1 time: 0.136984 Aug 09 16:58:09.492657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 467/965] 10.222.0.59 () {58 vars in 1254 bytes} [Tue Aug 9 16:58:09 2022] DELETE /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 16:58:09.499818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ebb5ea1c-816f-40d4-811d-34e906fad7c1 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4c52550>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:09.528788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ebb5ea1c-816f-40d4-811d-34e906fad7c1 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 200 len: 286 microversion: 2.1 time: 0.033610 Aug 09 16:58:09.529368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 499/966] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:09 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:10.145222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:10.145842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:10.152294 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:10.152783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:10.153222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:10.153917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:10.154376 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:10.154801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:10.159466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:10.287330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:10.294960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b3c97b6c-a6f6-46c2-91e6-9104be93fbda tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.153508 Aug 09 16:58:10.295563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 468/967] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:10 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:10.518370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:10.519124 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:10.525887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:10.526380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:10.526820 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:10.527557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:10.528018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:10.528449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:10.541325 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d7520771-1366-4003-8e97-b2ab42ca89be tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4d14a60>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:10.568270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-d7520771-1366-4003-8e97-b2ab42ca89be tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] HTTP exception thrown: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d7520771-1366-4003-8e97-b2ab42ca89be tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Request method failure captured: Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 HTTP/1.1 Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pIaaiWpVp9Jy15_GtHp1v7S7lrtpPfrFDSsOUj-pBBQ-mZWfqEmOPf-ZE3DC_Qb5JB1WR6CsfBDako3KU0MsxkvuR84QTkIFosZfeGTE7oRDZzRqlQMASuDTqZZqi3f6hcbe4ryOS5EQyoyP7ljbyPW218q9RrnokbYkPXpNtCrsEI Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:10.570478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c8e906e3a5d40a3aa654af904c6a04f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}] Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 25b2d8251506474087a74efb87b5e186 Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'b40f5fb5-6385-4229-82ec-e9b290548451'} Aug 09 16:58:10.572477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. (HTTP 404) (Request-ID: req-88ba7ebf-61ae-44fb-b0eb-a673fb34d013) Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.573460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:10.574623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 16:58:10.575797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d7520771-1366-4003-8e97-b2ab42ca89be tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Returning 404 to user: Snapshot b40f5fb5-6385-4229-82ec-e9b290548451 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:10.577082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d7520771-1366-4003-8e97-b2ab42ca89be tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451" status: 404 len: 111 microversion: 2.1 time: 0.034983 Aug 09 16:58:10.578439 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 469/968] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 9 16:58:10 2022] GET /compute/v2.1/os-snapshots/b40f5fb5-6385-4229-82ec-e9b290548451 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:10.581318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-92a6bfbc-d3f7-49b5-af7c-33b3af3367a1 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4c40a60>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:10.660937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:10.669369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-00a1431f-432c-4d4f-b6a2-d4e88137ea0f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1595 microversion: 2.1 time: 0.155580 Aug 09 16:58:10.669944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 500/969] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:10 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:10.767990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-92a6bfbc-d3f7-49b5-af7c-33b3af3367a1 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 202 len: 0 microversion: 2.1 time: 0.189258 Aug 09 16:58:10.767990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 470/970] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:58:10 2022] DELETE /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:58:10.776001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7d4824b8-7629-47f4-8c46-e7023c1d8a19 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4c1a4c0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:10.826866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7d4824b8-7629-47f4-8c46-e7023c1d8a19 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 200 len: 344 microversion: 2.1 time: 0.052480 Aug 09 16:58:10.826866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 501/971] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:58:10 2022] GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:11.316756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:11.317380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:11.323745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:11.324222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:11.324717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:11.325363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:11.325820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:11.326251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:11.458190 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:11.467604 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f4ab8756-514d-4e05-95b5-8d38b84e08f6 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.154311 Aug 09 16:58:11.469282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 471/972] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:11 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:11.839498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-77932e19-8ca6-4dcf-8720-9116a7d990b2 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4d67820>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:11.867798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-77932e19-8ca6-4dcf-8720-9116a7d990b2 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] HTTP exception thrown: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-77932e19-8ca6-4dcf-8720-9116a7d990b2 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Request method failure captured: Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 HTTP/1.1 Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pIaaiWpVp9Jy15_GtHp1v7S7lrtpPfrFDSsOUj-pBBQ-mZWfqEmOPf-ZE3DC_Qb5JB1WR6CsfBDako3KU0MsxkvuR84QTkIFosZfeGTE7oRDZzRqlQMASuDTqZZqi3f6hcbe4ryOS5EQyoyP7ljbyPW218q9RrnokbYkPXpNtCrsEI Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:58:11.871231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c8e906e3a5d40a3aa654af904c6a04f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}] Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 25b2d8251506474087a74efb87b5e186 Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '36c65eda-82c8-4b66-b3ea-1ee5147292c9'} Aug 09 16:58:11.872808 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. (HTTP 404) (Request-ID: req-a973a03a-eb44-4377-a807-487532d7043c) Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.873729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:11.875867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 16:58:11.877182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-77932e19-8ca6-4dcf-8720-9116a7d990b2 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Returning 404 to user: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:11.878389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-77932e19-8ca6-4dcf-8720-9116a7d990b2 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 404 len: 109 microversion: 2.1 time: 0.037752 Aug 09 16:58:11.879841 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 502/973] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:58:11 2022] GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:11.884867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9f5f5173-7482-454a-b7f8-12f81cfafab3 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4b4ef70>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:11.912957 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-9f5f5173-7482-454a-b7f8-12f81cfafab3 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] HTTP exception thrown: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9f5f5173-7482-454a-b7f8-12f81cfafab3 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Request method failure captured: Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 HTTP/1.1 Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pIaaiWpVp9Jy15_GtHp1v7S7lrtpPfrFDSsOUj-pBBQ-mZWfqEmOPf-ZE3DC_Qb5JB1WR6CsfBDako3KU0MsxkvuR84QTkIFosZfeGTE7oRDZzRqlQMASuDTqZZqi3f6hcbe4ryOS5EQyoyP7ljbyPW218q9RrnokbYkPXpNtCrsEI Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:11.914915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c8e906e3a5d40a3aa654af904c6a04f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}] Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 25b2d8251506474087a74efb87b5e186 Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '36c65eda-82c8-4b66-b3ea-1ee5147292c9'} Aug 09 16:58:11.916509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. (HTTP 404) (Request-ID: req-d4a59b39-c4b3-4013-a7d2-981dddda1736) Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.917381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 16:58:11.918512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 16:58:11.919666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9f5f5173-7482-454a-b7f8-12f81cfafab3 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Returning 404 to user: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9f5f5173-7482-454a-b7f8-12f81cfafab3 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 404 len: 109 microversion: 2.1 time: 0.035324 Aug 09 16:58:11.921463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 472/974] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:58:11 2022] DELETE /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:11.927625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-27715424-c11c-4c7d-ad87-4b336c4cb365 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Calling method '.version_select at 0x7fccc4d67820>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:11.954863 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-27715424-c11c-4c7d-ad87-4b336c4cb365 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] HTTP exception thrown: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-27715424-c11c-4c7d-ad87-4b336c4cb365 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Request method failure captured: Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 HTTP/1.1 Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pIaaiWpVp9Jy15_GtHp1v7S7lrtpPfrFDSsOUj-pBBQ-mZWfqEmOPf-ZE3DC_Qb5JB1WR6CsfBDako3KU0MsxkvuR84QTkIFosZfeGTE7oRDZzRqlQMASuDTqZZqi3f6hcbe4ryOS5EQyoyP7ljbyPW218q9RrnokbYkPXpNtCrsEI Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:58:11.956819 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5c8e906e3a5d40a3aa654af904c6a04f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5c8e906e3a5d40a3aa654af904c6a04f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5c8e906e3a5d40a3aa654af904c6a04f"}]}] Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 5c8e906e3a5d40a3aa654af904c6a04f Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1372615216 Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 25b2d8251506474087a74efb87b5e186 Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1372615216-project Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '36c65eda-82c8-4b66-b3ea-1ee5147292c9'} Aug 09 16:58:11.958443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. (HTTP 404) (Request-ID: req-d9ff27ca-3ff1-4dc6-8ba8-3ffa8b64a47a) Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.959477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:11.961033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 16:58:11.962437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-27715424-c11c-4c7d-ad87-4b336c4cb365 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] Returning 404 to user: Volume 36c65eda-82c8-4b66-b3ea-1ee5147292c9 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-27715424-c11c-4c7d-ad87-4b336c4cb365 tempest-VolumesSnapshotsTestJSON-1372615216 tempest-VolumesSnapshotsTestJSON-1372615216-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9" status: 404 len: 109 microversion: 2.1 time: 0.035944 Aug 09 16:58:11.963860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 503/975] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:58:11 2022] GET /compute/v2.1/os-volumes/36c65eda-82c8-4b66-b3ea-1ee5147292c9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:12.487845 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:12.489262 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=6 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:12.495603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:12.496479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:12.504645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:12.506074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:12.506689 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:12.507660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:12.508278 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:12.508858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:12.694315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:12.709986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2872ab86-b5f2-4b0c-b4fa-419d29dba2b7 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.216889 Aug 09 16:58:12.709986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 473/976] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:12 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:13.360215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:13.362447 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-b2aee654-a791-4a77-832c-da63d8d64d07 req-13ae7ce0-f42c-4256-8e65-b6fc2d0e63a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:13.374176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-b2aee654-a791-4a77-832c-da63d8d64d07 req-13ae7ce0-f42c-4256-8e65-b6fc2d0e63a5 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:13.375577 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-b2aee654-a791-4a77-832c-da63d8d64d07 req-13ae7ce0-f42c-4256-8e65-b6fc2d0e63a5 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:13.375763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-b2aee654-a791-4a77-832c-da63d8d64d07 req-13ae7ce0-f42c-4256-8e65-b6fc2d0e63a5 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:13.386853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-b2aee654-a791-4a77-832c-da63d8d64d07 req-13ae7ce0-f42c-4256-8e65-b6fc2d0e63a5 service nova] Creating event network-changed:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 16:58:13.392661 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-b2aee654-a791-4a77-832c-da63d8d64d07 req-13ae7ce0-f42c-4256-8e65-b6fc2d0e63a5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037117 Aug 09 16:58:13.393272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 504/977] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:13.730302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:13.736972 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:13.745763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:13.753851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:13.755554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:13.758243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:13.759486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:13.760252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:14.024795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:14.034009 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-724d3f1b-f6a7-48be-8a87-4baa7ae4522a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.312338 Aug 09 16:58:14.034770 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 474/978] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:13 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:14.619560 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-6eeed34a-e491-452d-99df-28ed3a760f3b req-6596c242-1c4a-4ce8-a785-715f34454a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7a0829-3182-4786-834f-fc42cca9ae3c", "name": "network-vif-plugged", "status": "completed", "tag": "90fc48d3-44e8-42b9-9e46-3bc83c4de9cb"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:14.630278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6eeed34a-e491-452d-99df-28ed3a760f3b req-6596c242-1c4a-4ce8-a785-715f34454a83 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:14.630837 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6eeed34a-e491-452d-99df-28ed3a760f3b req-6596c242-1c4a-4ce8-a785-715f34454a83 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:14.631426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6eeed34a-e491-452d-99df-28ed3a760f3b req-6596c242-1c4a-4ce8-a785-715f34454a83 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:14.646722 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-6eeed34a-e491-452d-99df-28ed3a760f3b req-6596c242-1c4a-4ce8-a785-715f34454a83 service nova] Creating event network-vif-plugged:90fc48d3-44e8-42b9-9e46-3bc83c4de9cb for instance eb7a0829-3182-4786-834f-fc42cca9ae3c on hv-cinder-85236 Aug 09 16:58:14.652241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-6eeed34a-e491-452d-99df-28ed3a760f3b req-6596c242-1c4a-4ce8-a785-715f34454a83 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037534 Aug 09 16:58:14.656271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 505/979] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:15.061262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:15.062955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:15.067679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cd3fd67a-2d2a-455c-a145-a964526a21f8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Action: 'create', calling method: .version_select at 0x7fccc4b9c790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-30849988", "metadata": {"Type": "work"}}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:15.071261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:15.071747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:15.072190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:15.072907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:15.073367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:15.073822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cd3fd67a-2d2a-455c-a145-a964526a21f8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Request method failure captured: Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 120 Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pImaSh0XpUslXh7WRycJJqVPAfjX6ID0Vgee0GgZ4-b7kfWgwZM0yt2sS9S0sVLmW6z3vv-61c-aaoPPAiES-W7FIe2kdPXqbaqDiz7-z2NsgbZwhsNX09UyRtrkeU7JhPiRsIXp2fFMzOxlQ918wrkATqOXRvTfu9S44AjBi-KnqI Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:15.084182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e85ef4a8f4ee40c2b77dd48380c34980", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}] Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: d3d88416993f4cd0992a79ad6040b6b2 Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-30849988", "metadata": {"Type": "work"}}} Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:15.085679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-30849988', 'metadata': {'Type': 'work'}}}} Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise error Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:15.086736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 16:58:15.088658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 16:58:15.091370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 16:58:15.091370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.091370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cd3fd67a-2d2a-455c-a145-a964526a21f8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:15.091370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cd3fd67a-2d2a-455c-a145-a964526a21f8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144508 Aug 09 16:58:15.091370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 475/980] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 16:58:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 16:58:15.098730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-357ee3d3-0332-433c-9094-3b83188f0f74 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Action: 'create', calling method: .version_select at 0x7fccc4b02f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1777456025", "metadata": {"Type": "work"}}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-357ee3d3-0332-433c-9094-3b83188f0f74 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Request method failure captured: Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 120 Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pImaSh0XpUslXh7WRycJJqVPAfjX6ID0Vgee0GgZ4-b7kfWgwZM0yt2sS9S0sVLmW6z3vv-61c-aaoPPAiES-W7FIe2kdPXqbaqDiz7-z2NsgbZwhsNX09UyRtrkeU7JhPiRsIXp2fFMzOxlQ918wrkATqOXRvTfu9S44AjBi-KnqI Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:15.103303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e85ef4a8f4ee40c2b77dd48380c34980", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}] Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: d3d88416993f4cd0992a79ad6040b6b2 Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1777456025", "metadata": {"Type": "work"}}} Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:15.105205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1777456025', 'metadata': {'Type': 'work'}}}} Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise error Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi '0' Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:15.106204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 16:58:15.107708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 16:58:15.109487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 16:58:15.109487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.109487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-357ee3d3-0332-433c-9094-3b83188f0f74 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:15.109487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-357ee3d3-0332-433c-9094-3b83188f0f74 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012808 Aug 09 16:58:15.109487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 476/981] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 16:58:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 16:58:15.115908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b5ee0eb0-9ffc-4780-842f-e01616c27a6b tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Action: 'create', calling method: .version_select at 0x7fccc4c51af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-46282686", "metadata": {"Type": "work"}}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b5ee0eb0-9ffc-4780-842f-e01616c27a6b tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Request method failure captured: Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 117 Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pImaSh0XpUslXh7WRycJJqVPAfjX6ID0Vgee0GgZ4-b7kfWgwZM0yt2sS9S0sVLmW6z3vv-61c-aaoPPAiES-W7FIe2kdPXqbaqDiz7-z2NsgbZwhsNX09UyRtrkeU7JhPiRsIXp2fFMzOxlQ918wrkATqOXRvTfu9S44AjBi-KnqI Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:15.119669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e85ef4a8f4ee40c2b77dd48380c34980", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}] Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: d3d88416993f4cd0992a79ad6040b6b2 Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-46282686", "metadata": {"Type": "work"}}} Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:15.128446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-46282686', 'metadata': {'Type': 'work'}}}} Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise error Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi '' Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:15.129322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 16:58:15.130719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 16:58:15.131966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 16:58:15.131966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.131966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b5ee0eb0-9ffc-4780-842f-e01616c27a6b tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:15.131966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b5ee0eb0-9ffc-4780-842f-e01616c27a6b tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009222 Aug 09 16:58:15.131966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 477/982] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 9 16:58:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 16:58:15.132386 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a2e76a08-19b3-4b40-b67d-cc5b3d72eff8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Calling method '.version_select at 0x7fccc4d0a550>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:15.161906 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-a2e76a08-19b3-4b40-b67d-cc5b3d72eff8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] HTTP exception thrown: Volume tempest-invalid-2140245913 could not be found. Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a2e76a08-19b3-4b40-b67d-cc5b3d72eff8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Request method failure captured: Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2140245913 HTTP/1.1 Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pImaSh0XpUslXh7WRycJJqVPAfjX6ID0Vgee0GgZ4-b7kfWgwZM0yt2sS9S0sVLmW6z3vv-61c-aaoPPAiES-W7FIe2kdPXqbaqDiz7-z2NsgbZwhsNX09UyRtrkeU7JhPiRsIXp2fFMzOxlQ918wrkATqOXRvTfu9S44AjBi-KnqI Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:15.163890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e85ef4a8f4ee40c2b77dd48380c34980", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}] Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: d3d88416993f4cd0992a79ad6040b6b2 Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Volume tempest-invalid-2140245913 could not be found. Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'tempest-invalid-2140245913'} Aug 09 16:58:15.165594 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2140245913 could not be found. (HTTP 404) (Request-ID: req-0d652098-b4ae-4922-8cc9-0f681815db72) Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.166657 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 16:58:15.168228 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2140245913 could not be found. Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:15.169633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2140245913 could not be found. Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2140245913 could not be found. Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a2e76a08-19b3-4b40-b67d-cc5b3d72eff8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Returning 404 to user: Volume tempest-invalid-2140245913 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a2e76a08-19b3-4b40-b67d-cc5b3d72eff8 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2140245913" status: 404 len: 99 microversion: 2.1 time: 0.036992 Aug 09 16:58:15.172503 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 478/983] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Aug 9 16:58:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2140245913 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 16:58:15.175186 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4f8f30ee-2238-4bef-a8b9-ae3d129fbac5 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003621 Aug 09 16:58:15.175678 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 479/984] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Aug 9 16:58:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 16:58:15.185317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2a2c0a01-d72e-4da5-a9ab-860c3e3dff5c tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004807 Aug 09 16:58:15.196470 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 480/985] 10.222.0.59 () {58 vars in 1137 bytes} [Tue Aug 9 16:58:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 09 16:58:15.205542 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ee8997c2-f5ed-44e0-80a6-db0cd02e3694 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Calling method '.version_select at 0x7fccc4d14280>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:15.236393 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-ee8997c2-f5ed-44e0-80a6-db0cd02e3694 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] HTTP exception thrown: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ee8997c2-f5ed-44e0-80a6-db0cd02e3694 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Request method failure captured: Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/os-volumes/a5694e51-2576-43e9-a965-1fbd79bbcdfe HTTP/1.1 Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pImaSh0XpUslXh7WRycJJqVPAfjX6ID0Vgee0GgZ4-b7kfWgwZM0yt2sS9S0sVLmW6z3vv-61c-aaoPPAiES-W7FIe2kdPXqbaqDiz7-z2NsgbZwhsNX09UyRtrkeU7JhPiRsIXp2fFMzOxlQ918wrkATqOXRvTfu9S44AjBi-KnqI Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:15.238693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e85ef4a8f4ee40c2b77dd48380c34980", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}] Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: d3d88416993f4cd0992a79ad6040b6b2 Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'a5694e51-2576-43e9-a965-1fbd79bbcdfe'} Aug 09 16:58:15.240458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. (HTTP 404) (Request-ID: req-6d409da0-f534-4079-9e17-edec2238b280) Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.241419 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 16:58:15.243048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 16:58:15.245015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ee8997c2-f5ed-44e0-80a6-db0cd02e3694 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Returning 404 to user: Volume a5694e51-2576-43e9-a965-1fbd79bbcdfe could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ee8997c2-f5ed-44e0-80a6-db0cd02e3694 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/a5694e51-2576-43e9-a965-1fbd79bbcdfe" status: 404 len: 109 microversion: 2.1 time: 0.039648 Aug 09 16:58:15.246557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 481/986] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:58:15 2022] DELETE /compute/v2.1/os-volumes/a5694e51-2576-43e9-a965-1fbd79bbcdfe => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:15.253116 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7c224df2-fdec-4ddf-b3b0-208b6be91183 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Calling method '.version_select at 0x7fccc4b4e4c0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:15.273278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:15.280883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-21006f3d-62b3-4c08-b0cb-cd08147559cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.226466 Aug 09 16:58:15.281482 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 506/987] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:15 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:15.283232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-7c224df2-fdec-4ddf-b3b0-208b6be91183 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] HTTP exception thrown: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7c224df2-fdec-4ddf-b3b0-208b6be91183 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Request method failure captured: Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/os-volumes/effa02ab-06c9-4481-9db6-80d30e8c965a HTTP/1.1 Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pImaSh0XpUslXh7WRycJJqVPAfjX6ID0Vgee0GgZ4-b7kfWgwZM0yt2sS9S0sVLmW6z3vv-61c-aaoPPAiES-W7FIe2kdPXqbaqDiz7-z2NsgbZwhsNX09UyRtrkeU7JhPiRsIXp2fFMzOxlQ918wrkATqOXRvTfu9S44AjBi-KnqI Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:15.284077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e85ef4a8f4ee40c2b77dd48380c34980"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e85ef4a8f4ee40c2b77dd48380c34980", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e85ef4a8f4ee40c2b77dd48380c34980"}]}] Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e85ef4a8f4ee40c2b77dd48380c34980 Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-66114460 Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: d3d88416993f4cd0992a79ad6040b6b2 Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-66114460-project Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'effa02ab-06c9-4481-9db6-80d30e8c965a'} Aug 09 16:58:15.285623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. (HTTP 404) (Request-ID: req-9d14d263-8089-47df-bff0-141c54d70dcb) Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.286583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 16:58:15.288077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 16:58:15.289514 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7c224df2-fdec-4ddf-b3b0-208b6be91183 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] Returning 404 to user: Volume effa02ab-06c9-4481-9db6-80d30e8c965a could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7c224df2-fdec-4ddf-b3b0-208b6be91183 tempest-VolumesNegativeTest-66114460 tempest-VolumesNegativeTest-66114460-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/effa02ab-06c9-4481-9db6-80d30e8c965a" status: 404 len: 109 microversion: 2.1 time: 0.039596 Aug 09 16:58:15.290889 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 482/988] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:58:15 2022] GET /compute/v2.1/os-volumes/effa02ab-06c9-4481-9db6-80d30e8c965a => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:16.302525 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:16.303148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:16.309583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:16.312765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:16.312765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:16.312765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:16.312765 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:16.313143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:16.430719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-944191351"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:16.431279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:16.439612 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:16.440344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:16.440781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:16.441486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:16.442118 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:16.442547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:16.466016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:16.473747 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b1551eb8-312f-414b-bd84-0c6059c920a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1314 microversion: 2.1 time: 0.175188 Aug 09 16:58:16.476079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 507/989] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:16 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:16.478831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:16.479359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:16.487042 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:16.487585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:16.488026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:16.488736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:16.489195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:16.489624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:16.513639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6772f83e-7ff8-4c14-a3f4-1485716d0d2c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/ips" status: 200 len: 151 microversion: 2.20 time: 0.038177 Aug 09 16:58:16.514231 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 508/990] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Aug 9 16:58:16 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:58:16.588322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.network.security_group_api [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Adding security group f3de0c48-41f5-4040-845d-389a653a25e5 to port 2934afc2-fa4e-4b03-9b5b-d9457d46077e Aug 09 16:58:16.995319 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6a700a9c-bf42-47fb-ad4b-dfed2f1771aa tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/action" status: 202 len: 0 microversion: 2.1 time: 0.566797 Aug 09 16:58:16.995319 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 483/991] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:58:16 2022] POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:58:17.004377 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:17.005453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:17.007490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-512fb5bb-14b1-4664-ad27-8c65fc186cf9 req-83d3060e-003a-4b6b-9e1e-16f574269756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:17.012156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:17.017727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:17.017727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:17.017727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:17.017727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:17.018326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:17.039348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-512fb5bb-14b1-4664-ad27-8c65fc186cf9 req-83d3060e-003a-4b6b-9e1e-16f574269756 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:17.043169 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-512fb5bb-14b1-4664-ad27-8c65fc186cf9 req-83d3060e-003a-4b6b-9e1e-16f574269756 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:17.043837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-512fb5bb-14b1-4664-ad27-8c65fc186cf9 req-83d3060e-003a-4b6b-9e1e-16f574269756 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:17.075698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-512fb5bb-14b1-4664-ad27-8c65fc186cf9 req-83d3060e-003a-4b6b-9e1e-16f574269756 service nova] Creating event network-changed:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 16:58:17.082222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-512fb5bb-14b1-4664-ad27-8c65fc186cf9 req-83d3060e-003a-4b6b-9e1e-16f574269756 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080274 Aug 09 16:58:17.084081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 484/992] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:17.250293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:17.271767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cd2d7071-4000-4c53-b0b1-180639e2d6bb tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1759 microversion: 2.1 time: 0.271333 Aug 09 16:58:17.273542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 509/993] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:16 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1759 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:17.495874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:17.498076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:17.506934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:17.507641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:17.508283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:17.509174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:17.510082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:17.510672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:17.739444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:17.747623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5864c289-daa3-4e5e-98f9-488f82593219 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1499 microversion: 2.1 time: 0.256083 Aug 09 16:58:17.751011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 485/994] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:17 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1499 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:18.892116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:18.892695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:18.899068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:18.899644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:18.900069 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:18.900934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:18.901557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:18.902118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:18.929303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:58:19.264094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7f710dfd-a9c6-4762-990f-83f34e58fbed tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "DELETE /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 204 len: 0 microversion: 2.1 time: 0.372751 Aug 09 16:58:19.264094 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 510/995] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:58:18 2022] DELETE /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:58:19.276063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:19.276872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:19.284341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:19.284841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:19.285285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:19.286070 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:19.286533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:19.286960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:19.421661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:19.429631 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-21a1a7b8-2912-4398-8db8-d4b477ab785e tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1505 microversion: 2.1 time: 0.159664 Aug 09 16:58:19.430207 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 486/996] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:19 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:19.451814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:19.452723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:19.459077 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:19.459372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:19.459799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:19.460598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:19.461061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:19.461484 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:19.494531 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lazy-loading 'flavor' on Instance uuid 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:19.919982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-18cd91fe-9735-4230-b407-d4cd9c17099e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/action" status: 202 len: 0 microversion: 2.20 time: 0.472388 Aug 09 16:58:19.920643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 511/997] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 16:58:19 2022] POST /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:58:19.929341 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:19.929963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:19.935853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:19.936338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:19.937258 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:19.937942 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:19.938400 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:19.938823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:20.071182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:20.079151 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:20.080658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:20.081829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-77632cde-8fa8-4fc1-b758-1c91ead9a4a2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.156331 Aug 09 16:58:20.082389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 487/998] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:19 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:20.452245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:20.453185 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:20.461997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:20.462493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:20.462929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:20.463804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:20.464132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:20.464560 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:20.598012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:20.605640 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f64224d7-f355-435e-b591-f08948a26deb tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1505 microversion: 2.1 time: 0.157918 Aug 09 16:58:20.614964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 512/999] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:20 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:20.795463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:20.796028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:20.802716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:20.809717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:20.809717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:20.809717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:20.809717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:20.810145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:20.828749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-061b4a30-2fcb-4a17-b64d-a7de16de1d72 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/ips" status: 200 len: 149 microversion: 2.1 time: 0.037180 Aug 09 16:58:20.829638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 488/1000] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 9 16:58:20 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:21.105315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:21.105857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:21.108268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:21.113670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:21.114158 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:21.114602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:21.115329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:21.115790 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:21.116224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:21.120277 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:21.254493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:21.262344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:21.263863 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:21.265021 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-81e78484-b30f-463a-98b0-0905030846ef tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.163737 Aug 09 16:58:21.266040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 513/1001] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:21 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:21.628835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:21.629512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:21.635740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:21.636257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:21.636665 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:21.637365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:21.637822 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:21.638252 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:21.873355 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:21.880961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f4aecba3-2201-4354-aa4d-ae8c278965d2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1505 microversion: 2.1 time: 0.256926 Aug 09 16:58:21.881551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 489/1002] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:21 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:22.201892 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-8e5234a0-63cf-4d82-9852-3694c7a5cecb req-2cca8dc4-f763-40fd-a527-ef56bd881c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7a0829-3182-4786-834f-fc42cca9ae3c", "name": "network-vif-deleted", "tag": "90fc48d3-44e8-42b9-9e46-3bc83c4de9cb"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:22.213146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-8e5234a0-63cf-4d82-9852-3694c7a5cecb req-2cca8dc4-f763-40fd-a527-ef56bd881c5c service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.213631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-8e5234a0-63cf-4d82-9852-3694c7a5cecb req-2cca8dc4-f763-40fd-a527-ef56bd881c5c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.214067 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-8e5234a0-63cf-4d82-9852-3694c7a5cecb req-2cca8dc4-f763-40fd-a527-ef56bd881c5c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.225452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-8e5234a0-63cf-4d82-9852-3694c7a5cecb req-2cca8dc4-f763-40fd-a527-ef56bd881c5c service nova] Creating event network-vif-deleted:90fc48d3-44e8-42b9-9e46-3bc83c4de9cb for instance eb7a0829-3182-4786-834f-fc42cca9ae3c on hv-cinder-85236 Aug 09 16:58:22.230317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-8e5234a0-63cf-4d82-9852-3694c7a5cecb req-2cca8dc4-f763-40fd-a527-ef56bd881c5c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Aug 09 16:58:22.231121 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 514/1003] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:22.288756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:22.290269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:22.297705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.298202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.298738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.299515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.299974 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.300407 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.433254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:22.441617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:22.443217 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:22.444437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-422dffb3-267a-4048-ad07-59cd6132c3f5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.159904 Aug 09 16:58:22.444999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 490/1004] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:22 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:22.593698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69082626-1159-4be6-93cc-1890f0b39ad5"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:22.596398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:22.603699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.604185 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.604618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.605318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.605777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.606196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.901788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:22.902338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:22.909820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.910303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.910736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.911540 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.911995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.912420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.953524 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:22.953875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:22.954445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:22.954897 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lazy-loading 'fault' on Instance uuid eb7a0829-3182-4786-834f-fc42cca9ae3c {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:22.995367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:23.002932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1cfdd077-0db6-4af4-aad4-0433bcade3a0 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1304 microversion: 2.1 time: 0.105047 Aug 09 16:58:23.003545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 491/1005] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:22 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:23.476383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:23.477007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:23.482967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:23.483487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:23.484117 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:23.484817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:23.485274 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:23.485698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:23.615914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:23.623866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:23.626170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:23.627367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c2764a3a-9361-497b-9e55-b03ac2960b3b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.155515 Aug 09 16:58:23.627923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 492/1006] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:23 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:24.024045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:24.024670 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:24.031217 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:24.031705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:24.032147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:24.032869 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:24.033331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:24.033758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:24.066163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:24.066700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:24.067218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:24.067716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lazy-loading 'fault' on Instance uuid eb7a0829-3182-4786-834f-fc42cca9ae3c {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:24.109948 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:24.117554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c60b1e88-f61e-448c-91aa-8e88acf72f1c tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1304 microversion: 2.1 time: 0.097507 Aug 09 16:58:24.118122 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 493/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:24 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:24.651415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:24.652030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:24.658146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:24.658628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:24.659083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:24.659860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:24.660318 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:24.660740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:24.791839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:24.800420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:24.801909 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:24.803073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-91762525-f6c1-4ab1-8509-e5df3919c356 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.155738 Aug 09 16:58:24.803647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 494/1008] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:24 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:25.137819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:25.138491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:25.141125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:25.145702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:25.146193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:25.146632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:25.147388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:25.147849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:25.148275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:25.181293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:25.181847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:25.182282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:25.182730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lazy-loading 'fault' on Instance uuid eb7a0829-3182-4786-834f-fc42cca9ae3c {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:25.227001 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:25.235386 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8b8f77e0-75c6-44d5-a572-0d93354883f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 200 len: 1304 microversion: 2.1 time: 0.100738 Aug 09 16:58:25.235956 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 495/1009] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:25 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:25.826655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:25.827312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:25.834102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:25.834583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:25.835177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:25.835816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:25.836269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:25.836691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:25.840730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:25.980704 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:25.989498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:25.990934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:25.992192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-226599b7-4b8a-4fe7-b1d8-b1671168aaa1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.169477 Aug 09 16:58:25.992751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 496/1010] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:25 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:26.216532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d439b68a-f19d-4e73-9b66-6a58e6451746 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "POST /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.628294 Aug 09 16:58:26.217535 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 515/1011] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 9 16:58:22 2022] POST /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments => generated 194 bytes in 3631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:26.256557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:26.257182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: eb7a0829-3182-4786-834f-fc42cca9ae3c] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:26.264023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:26.264533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:26.264851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:26.265560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:26.266080 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:26.267080 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:26.283331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] HTTP exception thrown: Instance eb7a0829-3182-4786-834f-fc42cca9ae3c could not be found. Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Request method failure captured: Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c HTTP/1.1 Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pIX9DZWe8__6StwmOFqcqkB_M9pNb5ESCPoLRoiPoWw1wR7ob9fURhtybIbWOGXnt8Bb7ebOBngSkHNI3n2efGHwp2cWv6Dr_Vks54i3Klv0DEzmlE-f_8wZUjAfMQf1zid8nuBB9E8oKF2qy501Cy9Ha4xADHGdwjX9UDaW_seZ9w Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 52db6dcf868e441b848d3a1dc2053080 Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesActionsTest-295748325 Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:26.285019 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/52db6dcf868e441b848d3a1dc2053080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/52db6dcf868e441b848d3a1dc2053080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_52db6dcf868e441b848d3a1dc2053080", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/52db6dcf868e441b848d3a1dc2053080"}]}] Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesActionsTest-295748325 Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 52db6dcf868e441b848d3a1dc2053080 Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesActionsTest-295748325 Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesActionsTest-295748325-project Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: a1244c06dbc94fc48437ec6bc78261ec Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesActionsTest-295748325-project Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance eb7a0829-3182-4786-834f-fc42cca9ae3c could not be found. Aug 09 16:58:26.286560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'eb7a0829-3182-4786-834f-fc42cca9ae3c'} Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7a0829-3182-4786-834f-fc42cca9ae3c could not be found. Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:26.287502 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7a0829-3182-4786-834f-fc42cca9ae3c could not be found. Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7a0829-3182-4786-834f-fc42cca9ae3c could not be found. Aug 09 16:58:26.288804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:26.291480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Returning 404 to user: Instance eb7a0829-3182-4786-834f-fc42cca9ae3c could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:26.291480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a8cbb695-c227-4626-8f2e-fbf7cb100d1b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c" status: 404 len: 111 microversion: 2.1 time: 0.033774 Aug 09 16:58:26.291480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 497/1012] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:26 2022] GET /compute/v2.1/servers/eb7a0829-3182-4786-834f-fc42cca9ae3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:26.420056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-32415088", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452", "networks": [{"uuid": "3ecd1e48-b208-40fa-9bc8-96d3528dd429"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:26.476165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] validate_networks() for [('3ecd1e48-b208-40fa-9bc8-96d3528dd429', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:58:26.827397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:58:26.827824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:58:26.828303 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:58:26.828812 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:58:26.829234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:58:26.840351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:26.840351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:26.840351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:26.840351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:26.840674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:26.840674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:26.857451 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Getting quotas for project 52db6dcf868e441b848d3a1dc2053080. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:58:26.862251 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Getting quotas for user a1244c06dbc94fc48437ec6bc78261ec and project 52db6dcf868e441b848d3a1dc2053080. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:58:26.873471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:58:26.876724 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:58:27.015992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:27.016619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:27.022616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:27.023116 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:27.023566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:27.024251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:27.024703 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:27.025132 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:27.066587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1f82c501-8688-48b8-9fd6-2af7d8562e91 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651166 Aug 09 16:58:27.077779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 516/1013] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:58:27.078080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f867a3fe-d1e4-4b84-86df-a2c7dbfa0a25 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:27.078733 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f867a3fe-d1e4-4b84-86df-a2c7dbfa0a25 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:27.153051 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f867a3fe-d1e4-4b84-86df-a2c7dbfa0a25 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:27.155141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f867a3fe-d1e4-4b84-86df-a2c7dbfa0a25 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1212 microversion: 2.1 time: 0.080783 Aug 09 16:58:27.168875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 517/1014] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:27 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:27.208142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:27.221984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:27.221984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:27.221984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1129427b-b791-411c-957a-64eb959af878 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.207345 Aug 09 16:58:27.222249 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 498/1015] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:27 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:28.176887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:28.177511 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:28.184268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:28.184762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:28.185198 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:28.185930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:28.186388 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:28.186814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:28.242709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:28.243371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:28.248825 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:28.250097 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:28.250654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:28.251332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:28.252104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:28.252567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:28.253006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:28.257189 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-45e78cd7-0cd3-4cb5-8c2a-3ee096d841f5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1216 microversion: 2.1 time: 0.084625 Aug 09 16:58:28.258018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 518/1016] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:28 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:28.388334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:28.399683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:28.401174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:28.402399 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-65d07b0e-22c0-45ea-9523-799fbab2f049 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.163643 Aug 09 16:58:28.402926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 499/1017] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:28 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:29.286237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:29.286237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:29.286237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:29.286869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:29.286869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:29.287628 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:29.288363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:29.288784 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:29.358169 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:29.367235 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6f08a3c5-4117-4947-8dd1-1ac6cda2525a tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1264 microversion: 2.1 time: 0.093016 Aug 09 16:58:29.367815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 519/1018] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:29 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:29.426214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:29.429553 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:29.434757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:29.435276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:29.435715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:29.436427 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:29.436879 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:29.437557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:29.660820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:29.669561 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:29.675273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:29.675273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3e4b655c-6783-420b-98d0-cc3476d715d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.250188 Aug 09 16:58:29.675273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 500/1019] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:29 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:30.388541 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:30.393208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:30.396256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:30.396744 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:30.397183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:30.397879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:30.398336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:30.398880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:30.550357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:30.558938 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d9f9824a-f697-4596-8bf4-1b973447d1b3 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.174311 Aug 09 16:58:30.559842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 520/1020] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:30 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:30.696751 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:30.697371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:30.703736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:30.704227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:30.705217 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:30.705923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:30.706447 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:30.707076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:30.892911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:30.901054 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:30.902646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:30.903867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-abaef385-ca7a-4a9a-81f1-38fb4a252b4e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.211477 Aug 09 16:58:30.904431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 501/1021] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:30 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:31.316156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-7a0868b6-dbe1-4489-bcc7-5972f07a000d req-d25e4447-7baf-4e28-8579-fce36246f8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "497f68e1-f24d-4f51-9013-032502f680dc", "tag": "31eee1ed-71d2-43ba-8d99-c6c548f1da2a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:31.326047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7a0868b6-dbe1-4489-bcc7-5972f07a000d req-d25e4447-7baf-4e28-8579-fce36246f8de service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:31.326543 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7a0868b6-dbe1-4489-bcc7-5972f07a000d req-d25e4447-7baf-4e28-8579-fce36246f8de service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:31.326961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7a0868b6-dbe1-4489-bcc7-5972f07a000d req-d25e4447-7baf-4e28-8579-fce36246f8de service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:31.338457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-7a0868b6-dbe1-4489-bcc7-5972f07a000d req-d25e4447-7baf-4e28-8579-fce36246f8de service nova] Creating event network-changed:31eee1ed-71d2-43ba-8d99-c6c548f1da2a for instance 497f68e1-f24d-4f51-9013-032502f680dc on hv-cinder-85236 Aug 09 16:58:31.343329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-7a0868b6-dbe1-4489-bcc7-5972f07a000d req-d25e4447-7baf-4e28-8579-fce36246f8de service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Aug 09 16:58:31.344156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 521/1022] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:31.581351 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:31.582192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:31.588310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:31.588794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:31.589231 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:31.589931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:31.590388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:31.590816 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:31.768756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:31.777607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b759264b-b065-479c-a0b0-6d1582a5c6e4 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.200271 Aug 09 16:58:31.778175 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 502/1023] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:31 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:31.927059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:31.927920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:31.934758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:31.935512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:31.935993 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:31.936650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:31.937107 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:31.937532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:32.075036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:32.083153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:32.084654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:32.087052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-25e532e7-dcbb-4a3f-8533-7ed189227df7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.163648 Aug 09 16:58:32.087052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 522/1024] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:31 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:32.797794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:32.799637 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:32.807465 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:32.807959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:32.808451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:32.809349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:32.809828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:32.810260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:32.944025 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:32.951650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-53111913-7c73-4d3f-ae72-03a8a3b51841 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.157734 Aug 09 16:58:32.952216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 503/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:32 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:33.108583 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:33.109197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:33.115559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:33.116038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:33.116478 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:33.117167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:33.117622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:33.118049 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:33.247948 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:33.256947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:33.258431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:33.259632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-077369c8-6f1c-4566-b13c-ea702677afac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.155018 Aug 09 16:58:33.260180 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 523/1026] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:33 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:33.974346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:33.975548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:33.983627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:33.984117 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:33.984548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:33.985239 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:33.985918 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:33.986640 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:34.138220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:34.146499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-66d95a23-4671-43e5-8ec1-e1a1e29fee0d tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.177942 Aug 09 16:58:34.148775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 504/1027] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:33 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:34.284857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:34.285818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:34.295818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:34.296584 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:34.297285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:34.299036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:34.299865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:34.300359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:34.448890 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:34.460146 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:34.461663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:34.462867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f060130e-458d-40bd-8683-c90ee82da324 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.182842 Aug 09 16:58:34.463468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 524/1028] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:34 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:35.117747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:35.118289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:35.124742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.125627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.125627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.127683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.128153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.128610 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.171411 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:35.172038 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:35.181208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.181691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.182122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.182818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.183297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.183718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.218539 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'services' on Instance uuid 46922118-bf1a-420f-9f62-5ae8da9be3e3 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:35.338389 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:35.348259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8734b0b9-73f1-49aa-b7f2-6d9f88ae7e7b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.181338 Aug 09 16:58:35.349594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 525/1029] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:35 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:35.452293 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-75169501-1b5e-43e7-a1f9-d607f02555ac tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments/69082626-1159-4be6-93cc-1890f0b39ad5" status: 202 len: 0 microversion: 2.1 time: 0.338351 Aug 09 16:58:35.452996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 505/1030] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 16:58:35 2022] DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments/69082626-1159-4be6-93cc-1890f0b39ad5 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:58:35.467080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:35.471697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:35.478916 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.479992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.481951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.482958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.483903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.484631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.493306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:35.493306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:35.496079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.496876 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.497579 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.498429 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:35.499216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:35.499875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:35.520424 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-89de4178-f5a4-46b9-b152-76f4f4e81519 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060982 Aug 09 16:58:35.521111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 526/1031] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:58:35 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:35.649709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:35.658733 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:35.660462 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:35.661725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-80038e30-4427-457a-9511-fe96e65d04ac tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.178975 Aug 09 16:58:35.662288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 506/1032] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:35 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:36.369157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:36.369900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:36.376772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.377264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.377701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.378395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.378854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.379319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.515631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:36.524214 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ff73f95c-ede4-409d-b218-38878f3aa6cf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.158820 Aug 09 16:58:36.524994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 527/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:36 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:36.534285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:36.537308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:36.544003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.544723 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.545229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.546055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.546582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.547071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.578493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d4c54167-3d91-4295-950a-ccd8e6ccad0e tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049744 Aug 09 16:58:36.579057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 507/1034] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:58:36 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:36.685540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:36.686215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:36.700193 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.700842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.701553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.702178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.702710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.703295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.760625 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-8ec97fd9-bde9-4a27-a34a-cb4239e0de56 req-fece7cb2-d471-4970-a3bc-120371b5d721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497f68e1-f24d-4f51-9013-032502f680dc", "name": "network-vif-plugged", "status": "completed", "tag": "31eee1ed-71d2-43ba-8d99-c6c548f1da2a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:36.770968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-8ec97fd9-bde9-4a27-a34a-cb4239e0de56 req-fece7cb2-d471-4970-a3bc-120371b5d721 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:36.771219 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-8ec97fd9-bde9-4a27-a34a-cb4239e0de56 req-fece7cb2-d471-4970-a3bc-120371b5d721 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:36.771826 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-8ec97fd9-bde9-4a27-a34a-cb4239e0de56 req-fece7cb2-d471-4970-a3bc-120371b5d721 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:36.783192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-8ec97fd9-bde9-4a27-a34a-cb4239e0de56 req-fece7cb2-d471-4970-a3bc-120371b5d721 service nova] Creating event network-vif-plugged:31eee1ed-71d2-43ba-8d99-c6c548f1da2a for instance 497f68e1-f24d-4f51-9013-032502f680dc on hv-cinder-85236 Aug 09 16:58:36.788229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-8ec97fd9-bde9-4a27-a34a-cb4239e0de56 req-fece7cb2-d471-4970-a3bc-120371b5d721 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Aug 09 16:58:36.794002 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 508/1035] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:36.847167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:36.857076 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:36.863608 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:36.865359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:36.866884 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c25444cb-609d-4e5e-9096-d60e7a21b4a6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.185598 Aug 09 16:58:36.867588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 528/1036] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:36 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:37.548044 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:37.549010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:37.555072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:37.558935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:37.558935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:37.558935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:37.558935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:37.559312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:37.591271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:37.593521 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:37.596454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=8 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:37.601946 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:37.602432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:37.602864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:37.603595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:37.604046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:37.604465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:37.639539 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6ebc4921-8b99-457a-8216-dd9e35a4ed30 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052139 Aug 09 16:58:37.640302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 529/1037] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:58:37 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:37.697415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:37.705938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-13d1fce5-7bca-4214-88ba-84b11d8af5c5 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.162520 Aug 09 16:58:37.706628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 509/1038] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:37 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:37.890110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:37.890522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:37.897336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:37.897827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:37.898279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:37.898995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:37.899632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:37.900078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.033507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:38.041976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:38.043504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:38.044708 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2ce82c75-4828-494e-aca5-6bf9230858eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1744 microversion: 2.20 time: 0.158784 Aug 09 16:58:38.045541 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 530/1039] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:37 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:38.653076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:38.655635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:38.662436 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:38.662927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:38.663426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.664144 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:38.664603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:38.665042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.698202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2ce1feb2-8473-450e-a70d-0e1a3bb9313f tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049534 Aug 09 16:58:38.698792 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 510/1040] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 16:58:38 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 16:58:38.726576 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:38.727228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:38.733516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:38.734003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:38.734441 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.735152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:38.736142 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:38.736581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.753737 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:38.764661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:38.765159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:38.771380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:38.771864 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:38.775257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.775257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:38.775257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:38.775257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:38.800636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:58:38.874707 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:38.883281 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0c0b5a3b-d478-4d71-b2ca-860905742cde tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1312 microversion: 2.1 time: 0.160481 Aug 09 16:58:38.883846 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 531/1041] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:38 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:38.920698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:39.036406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d15afeb2-4f0e-4a65-b2e2-617732d98456 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 204 len: 0 microversion: 2.1 time: 0.275296 Aug 09 16:58:39.037022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 511/1042] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:58:38 2022] DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 16:58:39.054682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:39.055455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:39.062178 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:39.062764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:39.063727 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:39.064567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:39.065100 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:39.065601 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:39.071523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:39.073877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:39.080849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:39.081533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:39.082373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:39.083089 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:39.083575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:39.083997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:39.215719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:39.228620 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:39.232242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e0935b20-aa77-408c-87ae-1bf2e79376d4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1681 microversion: 2.1 time: 0.174440 Aug 09 16:58:39.233057 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 532/1043] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:39 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:39.239358 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:39.241215 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:39.242580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3c13f080-cad9-4e2b-9449-68c89acf5a25 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1744 microversion: 2.20 time: 0.177308 Aug 09 16:58:39.243156 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 512/1044] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:39 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:39.903647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:39.904258 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:39.911132 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:39.911606 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:39.912040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:39.912736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:39.913182 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:39.913675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:40.050122 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:40.064465 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4216c1bf-80c4-4cc5-986e-fd8a062cc246 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1496 microversion: 2.1 time: 0.163956 Aug 09 16:58:40.069575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 533/1045] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:39 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:40.254185 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:40.254803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:40.261650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:40.262138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:40.262574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:40.263337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:40.263796 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:40.264220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:40.265991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:40.266751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:40.272891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:40.273385 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:40.273827 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:40.274527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:40.275141 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:40.275753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:40.409646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:40.417409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3ac465c0-f0d9-4eff-b119-45876ef98055 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1681 microversion: 2.1 time: 0.167486 Aug 09 16:58:40.417997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 513/1046] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:40 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:40.482259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:40.490749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:40.492262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:40.493428 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5a0eb3be-6ed0-4ab2-80bf-847762f64821 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1744 microversion: 2.20 time: 0.231440 Aug 09 16:58:40.493991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 534/1047] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:40 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1744 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:40.720537 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-b26dd31e-b220-4e66-82e0-2a77a7573c52 req-bcadf5fe-ae40-4d6f-b74e-b60883f75d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "name": "network-vif-plugged", "status": "completed", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:40.731375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-b26dd31e-b220-4e66-82e0-2a77a7573c52 req-bcadf5fe-ae40-4d6f-b74e-b60883f75d4d service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:40.731937 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-b26dd31e-b220-4e66-82e0-2a77a7573c52 req-bcadf5fe-ae40-4d6f-b74e-b60883f75d4d service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:40.732460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-b26dd31e-b220-4e66-82e0-2a77a7573c52 req-bcadf5fe-ae40-4d6f-b74e-b60883f75d4d service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:40.744036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-b26dd31e-b220-4e66-82e0-2a77a7573c52 req-bcadf5fe-ae40-4d6f-b74e-b60883f75d4d service nova] Creating event network-vif-plugged:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 16:58:40.749024 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-b26dd31e-b220-4e66-82e0-2a77a7573c52 req-bcadf5fe-ae40-4d6f-b74e-b60883f75d4d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032422 Aug 09 16:58:40.749625 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 514/1048] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:41.091344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:41.094007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:41.098518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.099033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.099504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.100202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.100749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.101196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.129213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:58:41.441134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:41.441881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:41.449538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.450028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.450655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.451241 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.454707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.454707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.505941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3fea0796-9fc6-431e-a077-4dd1cab77f06 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "DELETE /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 204 len: 0 microversion: 2.1 time: 0.417771 Aug 09 16:58:41.507616 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 535/1049] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:58:41 2022] DELETE /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:58:41.517190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:41.518856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:41.525149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.527519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.527519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.527519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.527519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.527929 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.621913 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:41.631798 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0ec32e46-1b99-4d35-a0d6-e3a5559d5de0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1681 microversion: 2.1 time: 0.195889 Aug 09 16:58:41.632393 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 515/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:41 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:41.638810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:41.645736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:41.660838 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.660981 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.661415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.662104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:41.662554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:41.662975 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:41.726221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:41.734706 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8836046b-4b76-4866-866c-60c85c513249 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1502 microversion: 2.1 time: 0.222687 Aug 09 16:58:41.735312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 536/1051] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:41 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:41.858084 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:41.866925 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:41.868565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:41.870118 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8c8dc6b4-1705-4a8a-a777-b105e51adb5f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1744 microversion: 2.20 time: 0.236792 Aug 09 16:58:41.871003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 516/1052] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:41 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:42.653701 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:42.654321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:42.660530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:42.661016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:42.661570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:42.662283 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:42.662721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:42.663181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:42.760070 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:42.761241 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:42.767969 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:42.770614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:42.770614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:42.770614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:42.770614 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:42.770978 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:42.804326 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:42.812495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dee472eb-03c8-4448-bbf3-19d996debc51 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1681 microversion: 2.1 time: 0.162563 Aug 09 16:58:42.813311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 537/1053] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:42 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:42.895329 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:42.896243 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:42.906652 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:42.909262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:42.910447 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:42.912237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:42.913320 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:42.914386 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:42.915974 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:42.925220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2b55f11f-be2f-45e0-bada-a0573f9d1451 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1502 microversion: 2.1 time: 0.168906 Aug 09 16:58:42.926375 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 517/1054] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:42 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:43.069744 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:43.077971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:43.079559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:43.080732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cdae6b99-e21b-4efb-b573-c7fd535eef77 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.190911 Aug 09 16:58:43.081461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 538/1055] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:42 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:43.835544 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:43.836746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:43.844346 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:43.845857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:43.846478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:43.847623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:43.848874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:43.849497 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:43.947900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:43.949347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:43.957692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:43.958263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:43.958954 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:43.959922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:43.960591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:43.961716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:44.166971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:44.176605 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d0d171a5-404c-401d-a245-971916913741 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1502 microversion: 2.1 time: 0.234170 Aug 09 16:58:44.181839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 539/1056] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:43 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:44.210109 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:44.212939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:44.220034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:44.239176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-87045e45-d012-4722-a100-f6b3a6bbefa6 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1681 microversion: 2.1 time: 0.405643 Aug 09 16:58:44.239176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 518/1057] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:43 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1681 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:44.274357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:44.279676 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:44.280239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:44.285555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:44.288736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:44.289304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:44.638022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:44.651268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:44.654422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:44.656363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-982ab955-9d31-46cd-923a-fafae771a0f2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.462944 Aug 09 16:58:44.660275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 540/1058] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:44 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:45.126873 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-fc5b742a-6dc9-4840-9fc6-6e784e20684b req-f89c0d30-1399-4f48-90df-a595c9ae5353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "497f68e1-f24d-4f51-9013-032502f680dc", "name": "network-vif-deleted", "tag": "31eee1ed-71d2-43ba-8d99-c6c548f1da2a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:45.156679 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fc5b742a-6dc9-4840-9fc6-6e784e20684b req-f89c0d30-1399-4f48-90df-a595c9ae5353 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.157557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fc5b742a-6dc9-4840-9fc6-6e784e20684b req-f89c0d30-1399-4f48-90df-a595c9ae5353 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.158291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-fc5b742a-6dc9-4840-9fc6-6e784e20684b req-f89c0d30-1399-4f48-90df-a595c9ae5353 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.171723 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-fc5b742a-6dc9-4840-9fc6-6e784e20684b req-f89c0d30-1399-4f48-90df-a595c9ae5353 service nova] Creating event network-vif-deleted:31eee1ed-71d2-43ba-8d99-c6c548f1da2a for instance 497f68e1-f24d-4f51-9013-032502f680dc on hv-cinder-85236 Aug 09 16:58:45.177853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-fc5b742a-6dc9-4840-9fc6-6e784e20684b req-f89c0d30-1399-4f48-90df-a595c9ae5353 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069692 Aug 09 16:58:45.181940 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 519/1059] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:58:45.203147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:45.211072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:45.230707 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.232460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.233088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.234711 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.235361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.237097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.270782 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:45.272540 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:45.286401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.288759 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.298717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.302558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.304747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.305523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.382561 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:45.393937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0992738c-f370-4fcc-a04d-58ddb223e4bf tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1460 microversion: 2.1 time: 0.195728 Aug 09 16:58:45.398362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 541/1060] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:45 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1460 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:45.402439 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:45.423875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7565de3e-c04e-4932-9478-603ea4e83960 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1613 microversion: 2.1 time: 0.157309 Aug 09 16:58:45.423875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 520/1061] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:45 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1613 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:45.719314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:45.719314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:45.719314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.719314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.719941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.719941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:45.719941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:45.719941 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:45.912496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:45.934511 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:45.937610 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:45.943349 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8aafebbd-3958-443d-a2b0-369ec4449606 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.259784 Aug 09 16:58:45.944208 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 542/1062] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:45 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:46.422022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:46.422643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:46.434203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:46.435289 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:46.435908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:46.436618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:46.437218 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:46.437777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:46.442844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:46.443542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:46.450181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:46.450669 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:46.451136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:46.458392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:46.463188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:46.463188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:46.529145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:46.549504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:46.558788 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-482f8450-281c-4e51-9d2e-91f357c87b74 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1613 microversion: 2.1 time: 0.119603 Aug 09 16:58:46.565876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 543/1063] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:46 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1613 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:46.569805 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cc1bb658-0398-43fd-8b24-b17227393db2 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1297 microversion: 2.1 time: 0.151378 Aug 09 16:58:46.575915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 521/1064] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:46 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1297 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:46.974396 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:46.975633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:46.983014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:46.983769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:46.984382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:46.985104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:46.987036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:46.987710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.135903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:47.145167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:47.147164 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:47.148456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-42bc8983-1f41-435c-b0f3-1f47ee8fcdc8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.179747 Aug 09 16:58:47.149097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 544/1065] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:46 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:47.194641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-0d84b7b7-e297-4f92-b664-0a588f3ebff9 req-0d27289b-fd53-45a0-8264-3ae2d4e4bc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46922118-bf1a-420f-9f62-5ae8da9be3e3", "name": "network-vif-deleted", "tag": "b3f31b42-fce1-423f-8902-589d9bd67308"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:47.204837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0d84b7b7-e297-4f92-b664-0a588f3ebff9 req-0d27289b-fd53-45a0-8264-3ae2d4e4bc93 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.205583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0d84b7b7-e297-4f92-b664-0a588f3ebff9 req-0d27289b-fd53-45a0-8264-3ae2d4e4bc93 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.206013 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-0d84b7b7-e297-4f92-b664-0a588f3ebff9 req-0d27289b-fd53-45a0-8264-3ae2d4e4bc93 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.217384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-0d84b7b7-e297-4f92-b664-0a588f3ebff9 req-0d27289b-fd53-45a0-8264-3ae2d4e4bc93 service nova] Creating event network-vif-deleted:b3f31b42-fce1-423f-8902-589d9bd67308 for instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 on hv-cinder-85236 Aug 09 16:58:47.222684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-0d84b7b7-e297-4f92-b664-0a588f3ebff9 req-0d27289b-fd53-45a0-8264-3ae2d4e4bc93 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 Aug 09 16:58:47.227191 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 522/1066] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:58:47.592512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:47.600673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:47.602391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:47.606045 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:47.613420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.613663 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.613913 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.614032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.614355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.614473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.615055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.615399 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.615868 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.616053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.616574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.616739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.693800 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:47.703268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b77c464f-11cb-4b0a-b89f-dbfd7145443b tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1297 microversion: 2.1 time: 0.108746 Aug 09 16:58:47.706650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 523/1067] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:47 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:47.713272 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:47.716515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:47.719022 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:47.722526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0f7b8042-989a-4050-a4c4-367d8f90b150 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1326 microversion: 2.1 time: 0.133803 Aug 09 16:58:47.723412 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 545/1068] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:47 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:47.726825 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.727509 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.728166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:47.728983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:47.729547 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:47.730097 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.174564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:48.176040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:48.184035 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.185813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.186526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.187944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.189360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.189756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-64aad43b-50ea-4e9b-ae73-99e889929a20 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/action" status: 202 len: 0 microversion: 2.1 time: 0.481714 Aug 09 16:58:48.190281 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.194475 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 524/1069] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 16:58:47 2022] POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:58:48.201567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:48.202586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:48.209870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:48.221592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.222412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.223238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.228492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.228492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.228492 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.367860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:48.378519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:48.380357 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:48.382306 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fd03196a-239d-4437-b5ec-b933a124488f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.213099 Aug 09 16:58:48.396858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 546/1070] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:48 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:48.419771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:48.428912 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5205240f-f7c9-41bc-a58a-8c6519647af7 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1751 microversion: 2.1 time: 0.233017 Aug 09 16:58:48.429722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 525/1071] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:48 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:48.729554 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:48.731073 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:48.739626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.740118 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.740845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.741471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.741995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.742516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.746166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:48.746835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:48.756171 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.756992 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.757609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.758515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.759145 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.759743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.788798 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.789288 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.789730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.790188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lazy-loading 'fault' on Instance uuid 497f68e1-f24d-4f51-9013-032502f680dc {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:48.799605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:48.800466 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:48.801119 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:48.801867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lazy-loading 'fault' on Instance uuid 46922118-bf1a-420f-9f62-5ae8da9be3e3 {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:58:48.833652 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1244c06dbc94fc48437ec6bc78261ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52db6dcf868e441b848d3a1dc2053080', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:48.844271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ac6c4011-cb37-4024-86c8-aeca150bcc14 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 200 len: 1302 microversion: 2.1 time: 0.121386 Aug 09 16:58:48.845944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 547/1072] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:48 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:48.869442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e895e683cb964e599e235378f31e1c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321de2c92d814e6ab1da13939153da87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:48.879643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8fad1c05-48dd-4637-9205-c719ee1614a0 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 200 len: 1331 microversion: 2.1 time: 0.137436 Aug 09 16:58:48.880568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 526/1073] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:48 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:49.412756 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:49.414110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:49.432278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.433237 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.433865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.435332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.435959 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.436556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.468870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:49.469716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:49.483960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.484760 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.486169 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.489366 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.490027 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.491440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.731149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:49.756881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:49.760078 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:49.768698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f735b1d1-ae61-4857-adb5-2724aff49d13 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.358917 Aug 09 16:58:49.768698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 548/1074] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:49 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:49.863076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:49.873852 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:49.874712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] [instance: 497f68e1-f24d-4f51-9013-032502f680dc] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:49.875932 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-691ec699-aa74-4108-b777-b8e6f6f51f6d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1751 microversion: 2.1 time: 0.430008 Aug 09 16:58:49.877790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 527/1075] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:49 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1751 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:49.903684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:49.904402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:49.906880 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.911585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.912481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.912628 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.913476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.914048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.914580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.915222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.915808 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.916241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:49.917942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:49.920242 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:49.936621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 HTTP/1.1 Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:49.939301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:49.940976 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '46922118-bf1a-420f-9f62-5ae8da9be3e3'} Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:49.941919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:49.943584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.946113 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:49.955036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3f5a8eaf-1263-4ec2-96f4-069b53192dad tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 404 len: 111 microversion: 2.1 time: 0.056759 Aug 09 16:58:49.956363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 528/1076] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:49 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:49.966433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] HTTP exception thrown: Instance 497f68e1-f24d-4f51-9013-032502f680dc could not be found. Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Request method failure captured: Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc HTTP/1.1 Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pIX9DZWe8__6StwmOFqcqkB_M9pNb5ESCPoLRoiPoWw1wR7ob9fURhtybIbWOGXnt8Bb7ebOBngSkHNI3n2efGHwp2cWv6Dr_Vks54i3Klv0DEzmlE-f_8wZUjAfMQf1zid8nuBB9E8oKF2qy501Cy9Ha4xADHGdwjX9UDaW_seZ9w Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 52db6dcf868e441b848d3a1dc2053080 Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-VolumesActionsTest-295748325 Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:58:49.970506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/52db6dcf868e441b848d3a1dc2053080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/52db6dcf868e441b848d3a1dc2053080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_52db6dcf868e441b848d3a1dc2053080", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/52db6dcf868e441b848d3a1dc2053080"}]}] Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-VolumesActionsTest-295748325 Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 52db6dcf868e441b848d3a1dc2053080 Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-VolumesActionsTest-295748325 Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-VolumesActionsTest-295748325-project Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: a1244c06dbc94fc48437ec6bc78261ec Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-VolumesActionsTest-295748325-project Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 497f68e1-f24d-4f51-9013-032502f680dc could not be found. Aug 09 16:58:49.972362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '497f68e1-f24d-4f51-9013-032502f680dc'} Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 497f68e1-f24d-4f51-9013-032502f680dc could not be found. Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:49.973323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 497f68e1-f24d-4f51-9013-032502f680dc could not be found. Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 497f68e1-f24d-4f51-9013-032502f680dc could not be found. Aug 09 16:58:49.974824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:49.979128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] Returning 404 to user: Instance 497f68e1-f24d-4f51-9013-032502f680dc could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:49.979128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ba74124f-4df7-4ce0-834e-5c9184f14ab8 tempest-VolumesActionsTest-295748325 tempest-VolumesActionsTest-295748325-project] 10.222.0.59 "GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc" status: 404 len: 111 microversion: 2.1 time: 0.108870 Aug 09 16:58:49.979128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 549/1077] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:49 2022] GET /compute/v2.1/servers/497f68e1-f24d-4f51-9013-032502f680dc => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:49.988234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c71b5762-534d-4d8d-886d-48349953f65d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '.version_select at 0x7fccc4b9cca0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:50.072995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c71b5762-534d-4d8d-886d-48349953f65d tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224310522" status: 202 len: 0 microversion: 2.1 time: 0.102349 Aug 09 16:58:50.077162 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 529/1078] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 9 16:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224310522 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:58:50.793705 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:50.795646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:50.808264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:50.809501 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:50.810149 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:50.811148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:50.811832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:50.812496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:50.904026 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:50.905319 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:50.928973 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:50.929593 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:50.930043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:50.930921 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:50.931613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:50.932205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:51.009540 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:51.022776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:51.024782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:51.029529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-20ce716b-f21c-4a7d-8ca5-2182b376df05 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.240726 Aug 09 16:58:51.047138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 550/1079] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:50 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:51.267764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:51.271870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:51.277711 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-0e75318d-41c0-48c2-82e1-dfff839b8ee4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.378275 Aug 09 16:58:51.278721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 530/1080] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:50 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:52.066864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:52.067469 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:52.069896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:52.074996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:52.075526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:52.075968 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:52.076667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:52.077150 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:52.077646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:52.213715 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:52.222417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:52.223945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:52.225323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-afd30c84-0f9f-4061-bc35-8a6847420b61 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.163348 Aug 09 16:58:52.226005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 551/1081] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:52 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:52.304744 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:52.305409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:52.318464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:52.318953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:52.319520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:52.320408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:52.321120 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:52.321875 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:52.483037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:52.493331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e9c14961-abae-4d5d-a05f-6f48baaf35c0 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.195226 Aug 09 16:58:52.493931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 531/1082] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:52 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:53.253513 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:53.254589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:53.264295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:53.265024 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:53.265646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:53.266569 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:53.269495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:53.272127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:53.494099 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:53.504353 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:53.505949 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:53.507259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b9d7312d-2608-489d-945d-90e46f8bf1db tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.261345 Aug 09 16:58:53.507912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 552/1083] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:53 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:53.527558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:53.528182 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:53.535627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:53.536179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:53.536617 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:53.537586 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:53.538067 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:53.538515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:53.711797 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:53.722762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d1d27e76-7fc7-415c-8104-f17589df6d52 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.210824 Aug 09 16:58:53.737738 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 532/1084] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:53 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:54.288397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1455255084", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-983199229", "security_groups": [{"name": "tempest-secgroup-smoke-1542149782"}], "block_device_mapping_v2": [{"uuid": "e50c4e7c-17f5-40d5-8180-75aba699f89f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03ca7ab9-4a6d-42ee-86c4-e644a355c008"}]}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:58:54.432901 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.network.neutron [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] validate_networks() for [('03ca7ab9-4a6d-42ee-86c4-e644a355c008', None, None, None, None, None)] {{(pid=124900) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:58:54.537317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:54.539871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:54.551574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:54.552762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:54.554238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:54.556177 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:54.558345 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:54.559934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:54.741264 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:54.780626 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:54.788965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:54.790965 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-19a04baf-d81f-437b-97a1-63275d091e3c tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.259923 Aug 09 16:58:54.794683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 533/1085] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:54 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:54.807453 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:54.808732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:54.843696 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:54.847900 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:54.848559 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:54.850756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:54.852277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:54.855343 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:55.058688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Flavor limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:58:55.059653 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Image limits 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:58:55.061746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Flavor pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:58:55.061746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Image pref 0:0:0 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:58:55.061746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.virt.hardware [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124900) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:58:55.080337 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:55.081726 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:55.082631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:55.083732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:55.084553 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:55.086625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:55.113432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:58:55.119308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.quota [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Getting quotas for user 02b21bed2f2d4e58b3759349331d44c7 and project e5e7f48ecafa4bfe80fadd50e0b24cbb. Resources: {'instances', 'cores', 'ram'} {{(pid=124900) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:58:55.157291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:55.169400 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1de2b482-790e-4a4f-b21f-56c38b2a48df tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.373096 Aug 09 16:58:55.173494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 534/1086] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:54 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:55.217648 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Going to run 1 instances... {{(pid=124900) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:58:55.220451 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e50c4e7c-17f5-40d5-8180-75aba699f89f',volume_size=None,volume_type=None)] {{(pid=124900) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:58:55.826122 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:55.827254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:55.831600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:58:55.834984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:55.835974 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:55.836550 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:55.837434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:55.837530 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:55.837907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:55.977011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:55.984943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:55.992930 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:55.994212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e94a253e-9cda-4cdd-a841-61bbcbecf730 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.173790 Aug 09 16:58:55.994717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 535/1087] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:55 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:58:56.176577 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f99ab054-923d-473a-b6e4-90e1643ec600 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.892413 Aug 09 16:58:56.177570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 553/1088] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 16:58:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 16:58:56.190221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-81693fbf-9a60-4fab-bb9e-a859cd8d6eb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:56.190899 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-81693fbf-9a60-4fab-bb9e-a859cd8d6eb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:56.204682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:56.205279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:56.230442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:56.230914 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:56.231372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:56.232104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:56.232550 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:56.232971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:56.288244 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-81693fbf-9a60-4fab-bb9e-a859cd8d6eb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:56.300418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-81693fbf-9a60-4fab-bb9e-a859cd8d6eb4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1094 microversion: 2.1 time: 0.111047 Aug 09 16:58:56.301220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 536/1089] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:56 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:56.442160 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:56.453011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f76711d0-afcb-44ae-a043-6fe19859ecca tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.252540 Aug 09 16:58:56.469431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 554/1090] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:56 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:57.017743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:57.018467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:57.025288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.025768 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.026202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.026888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.027370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.027793 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.146089 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:57.146590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:57.152533 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.153018 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.153455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.154157 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.154625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.155050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.177322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:57.189100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:57.191734 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:57.193386 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e86f12b5-bb8c-432b-ac3d-b8dce3ac0080 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1739 microversion: 2.20 time: 0.179676 Aug 09 16:58:57.194064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 537/1091] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:57 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:57.198687 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 HTTP/1.1 Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:58:57.200815 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.213119 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '46922118-bf1a-420f-9f62-5ae8da9be3e3'} Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:57.214002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.215450 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.216761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:57.216761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-970b6272-2bb9-47d3-afee-92e78e499abf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 404 len: 111 microversion: 2.1 time: 0.060353 Aug 09 16:58:57.216761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 555/1092] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:58:57 2022] DELETE /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:57.220691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:57.221315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 46922118-bf1a-420f-9f62-5ae8da9be3e3] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:57.227559 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.228050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.228486 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.229185 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.229638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.230064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.244837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 HTTP/1.1 Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:57.245931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.247660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '46922118-bf1a-420f-9f62-5ae8da9be3e3'} Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:57.248496 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. Aug 09 16:58:57.249860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:57.251237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance 46922118-bf1a-420f-9f62-5ae8da9be3e3 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:57.251237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-197afdc8-6be6-4288-9b44-feb34293e21a tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3" status: 404 len: 111 microversion: 2.1 time: 0.031815 Aug 09 16:58:57.251237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 538/1093] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:57 2022] GET /compute/v2.1/servers/46922118-bf1a-420f-9f62-5ae8da9be3e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:57.321202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:57.326145 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:57.334598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.335250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.335646 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.337019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.337759 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.338195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.415452 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:57.423477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a45b3142-2abc-43fb-bd34-dbeccfac2b56 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1144 microversion: 2.1 time: 0.106045 Aug 09 16:58:57.424156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 556/1094] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:57 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1144 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:57.480812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:57.482917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:57.492909 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.493409 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.494056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.494834 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:57.495645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:57.496333 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:57.667361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:57.675968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-58408366-ae11-4c71-a2f6-c2f97e2ee00b tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.201213 Aug 09 16:58:57.676544 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 539/1095] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:57 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:58.217322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.218143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.225138 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.225624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.226064 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.226769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.227256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.227684 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.399945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:58.411219 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:58.413777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:58.415638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3e48a745-7224-4685-8ffc-7e3de928c161 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1721 microversion: 2.20 time: 0.202625 Aug 09 16:58:58.416419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 557/1096] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:58 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:58.448666 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.449338 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.476008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.476512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.476963 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.477676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.478157 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.482558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.569604 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:58.586758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fb58a6f2-77fe-4a76-85ff-aa8b10b3e8ef tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1192 microversion: 2.1 time: 0.142261 Aug 09 16:58:58.590389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 540/1097] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:58 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1192 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:58:58.592135 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.593233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.609720 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.611478 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.612626 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.615063 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.616517 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.617655 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.641314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 HTTP/1.1 Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:58:58.645290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.647153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'ead4e2e4-484b-4150-81ce-4cfc1e9a1c06'} Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:58.648081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.649697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.652767 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:58.653743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-418f069c-f769-4e81-9e03-04d0cfaa4e57 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 404 len: 111 microversion: 2.1 time: 0.066306 Aug 09 16:58:58.654638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 558/1098] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:58:58 2022] DELETE /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:58.663807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.664583 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: ead4e2e4-484b-4150-81ce-4cfc1e9a1c06] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.670953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.671819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.675128 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.676242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.677274 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.677927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.693993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 HTTP/1.1 Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:58.695926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.697554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'ead4e2e4-484b-4150-81ce-4cfc1e9a1c06'} Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:58.698299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. Aug 09 16:58:58.699601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.702147 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:58.706271 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4ca9a5fc-a0c3-4c3d-bc3c-ba57a843e1ec tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06" status: 404 len: 111 microversion: 2.1 time: 0.044203 Aug 09 16:58:58.707549 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 541/1099] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:58 2022] GET /compute/v2.1/servers/ead4e2e4-484b-4150-81ce-4cfc1e9a1c06 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:58.721519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.722256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.730336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.731372 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.739975 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.740701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.741523 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.742722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.743788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.744644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.749225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.749845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.750299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.757757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.758585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.759323 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.767904 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 HTTP/1.1 Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:58.770634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.772092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'cb82bef7-ce2f-4541-b695-2b1769932f23'} Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:58.772890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.775007 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.776304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:58.776304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d4371a6e-43fb-4ad4-babe-aae479069bdf tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 404 len: 111 microversion: 2.1 time: 0.060537 Aug 09 16:58:58.777430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 542/1100] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:58:58 2022] DELETE /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:58:58.786757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:58.787663 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: cb82bef7-ce2f-4541-b695-2b1769932f23] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:58.799459 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.799961 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.800580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.801717 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:58.802646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:58.803339 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:58.843083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 HTTP/1.1 Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 16:58:58.846646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.857161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'cb82bef7-ce2f-4541-b695-2b1769932f23'} Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:58:58.858061 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. Aug 09 16:58:58.859344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 16:58:58.861245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance cb82bef7-ce2f-4541-b695-2b1769932f23 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:58:58.861245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2f5cd301-2bac-4ac1-848a-9c1698e58d29 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23" status: 404 len: 111 microversion: 2.1 time: 0.068699 Aug 09 16:58:58.861245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 543/1101] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:58 2022] GET /compute/v2.1/servers/cb82bef7-ce2f-4541-b695-2b1769932f23 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:58:58.999757 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:59.009489 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0a2fc5e4-75f1-4874-931a-07fb4fad0eb1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.316058 Aug 09 16:58:59.010667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 559/1102] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:58 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:58:59.447533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:59.448438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:59.458277 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:59.461967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:59.462624 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:59.464143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:59.464604 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:59.465030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:59.608910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:58:59.609551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:58:59.616452 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:59.619683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:59.620241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:59.620675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:59.624497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:58:59.625200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:58:59.625647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:58:59.627832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:59.630900 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:59.633075 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f132711f-2909-48ff-9818-99e53f27908f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1721 microversion: 2.20 time: 0.191543 Aug 09 16:58:59.636374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 544/1103] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:58:59 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:58:59.715854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:58:59.724304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-892e4416-085b-444a-8c6a-0bc0412f9331 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1210 microversion: 2.1 time: 0.119518 Aug 09 16:58:59.724885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 560/1104] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:58:59 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:00.036691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:00.037579 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:00.045442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.046259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.046701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.047716 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.049654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.050268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.199807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:00.199807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:00.199807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.199807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.200170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.200170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.200170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.200170 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.214286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c HTTP/1.1 Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:59:00.216176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.217830 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '2c13ec5a-b577-4bed-aa8c-ce73b8391b3c'} Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:59:00.218752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.220796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.223188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:59:00.224058 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-bcd09383-b181-482a-a3df-4023e44641b4 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 404 len: 111 microversion: 2.1 time: 0.037849 Aug 09 16:59:00.224631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 561/1105] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 16:59:00 2022] DELETE /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:59:00.236218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:00.237515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] [instance: 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:00.242125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:00.245602 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.246098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.246544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.247364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.247833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.248264 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.252164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-35d16558-0896-4a6a-bbae-f1a7f4cfe637 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.221943 Aug 09 16:59:00.252952 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 545/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:00 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:00.272764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] HTTP exception thrown: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Request method failure captured: Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c HTTP/1.1 Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pBicutkTGzOVQT1X9D78UhgmNorZa5ra5wIgjFGV4csP9Mnju7Rj0rdaidYPqUAvCUyV1KJElp2A825so0FGGC73_DkEo75bFvAJkuq2_F3SobRS9d1iXtfdxShD9t4xcW6PJKAtJEmRtQocv4ZIUCVK6xVTHcolFAWNqKfllBRydk Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 16:59:00.276421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/321de2c92d814e6ab1da13939153da87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_321de2c92d814e6ab1da13939153da87", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/321de2c92d814e6ab1da13939153da87"}]}] Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 321de2c92d814e6ab1da13939153da87 Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1759441517 Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: e895e683cb964e599e235378f31e1c9f Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeNegativeTest-1759441517-project Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.278016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '2c13ec5a-b577-4bed-aa8c-ce73b8391b3c'} Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:59:00.279074 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. Aug 09 16:59:00.284515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 16:59:00.286367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] Returning 404 to user: Instance 2c13ec5a-b577-4bed-aa8c-ce73b8391b3c could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:59:00.286367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fc7eda2b-13c1-40c5-9a36-6d9f815d6000 tempest-AttachVolumeNegativeTest-1759441517 tempest-AttachVolumeNegativeTest-1759441517-project] 10.222.0.59 "GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c" status: 404 len: 111 microversion: 2.1 time: 0.047313 Aug 09 16:59:00.286367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 562/1107] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:00 2022] GET /compute/v2.1/servers/2c13ec5a-b577-4bed-aa8c-ce73b8391b3c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:59:00.661895 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:00.675721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:00.682935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.683817 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.684308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.685209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.685814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.686242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.748072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:00.748933 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:00.759952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.761047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.761705 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:00.763052 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:00.764854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:00.765849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:01.009281 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:01.023676 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:01.025602 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:01.027273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cde546d8-2e6b-4f4f-a936-7059d5841bd2 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1721 microversion: 2.20 time: 0.371830 Aug 09 16:59:01.045941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 546/1108] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:00 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:01.046310 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:01.046661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-18d221a5-92a5-400d-9723-62e163cafd9e req-4bafba2c-0ada-47cf-ab47-04b1a388a1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "name": "network-vif-unplugged", "status": "completed", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:01.046771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-6269a026-229a-420a-9d8e-812df24f502f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1210 microversion: 2.1 time: 0.296823 Aug 09 16:59:01.046771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 563/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:00 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1210 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:01.056386 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-18d221a5-92a5-400d-9723-62e163cafd9e req-4bafba2c-0ada-47cf-ab47-04b1a388a1bf service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:01.057528 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-18d221a5-92a5-400d-9723-62e163cafd9e req-4bafba2c-0ada-47cf-ab47-04b1a388a1bf service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:01.058125 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-18d221a5-92a5-400d-9723-62e163cafd9e req-4bafba2c-0ada-47cf-ab47-04b1a388a1bf service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:01.077718 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-18d221a5-92a5-400d-9723-62e163cafd9e req-4bafba2c-0ada-47cf-ab47-04b1a388a1bf service nova] Creating event network-vif-unplugged:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 16:59:01.083690 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-18d221a5-92a5-400d-9723-62e163cafd9e req-4bafba2c-0ada-47cf-ab47-04b1a388a1bf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053500 Aug 09 16:59:01.085023 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 547/1110] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:01.273470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:01.274133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:01.280282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:01.281006 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:01.281446 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:01.282221 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:01.282692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:01.283151 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:01.627696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:01.641207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f6e53997-6e9c-4b06-9aca-64a357d3c5c8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.371518 Aug 09 16:59:01.644084 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 564/1111] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:01 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:02.057102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:02.058124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:02.066661 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.067202 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.067647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.067783 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:02.068297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:02.068476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.068870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.069362 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.076971 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.077739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.087407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.091136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.092682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.092682 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.213033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:02.246958 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d74f888d-0130-4333-8468-35952b0c88a8 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1210 microversion: 2.1 time: 0.186579 Aug 09 16:59:02.252216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 565/1112] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:02 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:02.474357 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:02.484806 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:02.490574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:02.495328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-26e4bbd3-2667-42f1-a2ce-4456723f4792 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1724 microversion: 2.20 time: 0.445035 Aug 09 16:59:02.496554 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 548/1113] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:02 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:02.539426 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d4c1088-ded7-435f-a5e3-6b71a8663f5f"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:02.545125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:02.568625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.569516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.570974 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.588327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.589262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.596976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.664997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:02.665633 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:02.678395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.679032 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.679512 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.685605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:02.686104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:02.686555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:02.725620 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=100 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:03.075762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:03.088406 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-300f5488-8801-4c46-8357-df9a643d7d6f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.427738 Aug 09 16:59:03.091893 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 549/1114] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:02 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:03.274263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:03.275238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:03.289064 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:03.292910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:03.297579 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:03.299828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:03.300323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:03.300763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:03.682269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:03.717726 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ebd81dbe-ad41-452c-bd3b-90edd543c86e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1278 microversion: 2.1 time: 0.445675 Aug 09 16:59:03.731135 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 550/1115] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:03 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1278 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:03.988629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-41d132f4-f818-481d-905e-49392ca213d4 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.468169 Aug 09 16:59:03.989250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 566/1116] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Aug 9 16:59:02 2022] POST /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-volume_attachments => generated 188 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 16:59:04.132323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:04.132323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:04.163710 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.168130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.168130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:04.168130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.168130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.168551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:04.228395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-d52ca23c-e2c0-4587-943e-49d69a84d8c4 req-373998c5-b18d-4304-9b47-5dfbaba9add3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d6d438-7e26-4e3d-a088-ca3312a4d746", "tag": "764f036a-2fe6-4b66-9ae3-77f17f6b705f"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:04.242849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d52ca23c-e2c0-4587-943e-49d69a84d8c4 req-373998c5-b18d-4304-9b47-5dfbaba9add3 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.243649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d52ca23c-e2c0-4587-943e-49d69a84d8c4 req-373998c5-b18d-4304-9b47-5dfbaba9add3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.244419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d52ca23c-e2c0-4587-943e-49d69a84d8c4 req-373998c5-b18d-4304-9b47-5dfbaba9add3 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:04.261700 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-d52ca23c-e2c0-4587-943e-49d69a84d8c4 req-373998c5-b18d-4304-9b47-5dfbaba9add3 service nova] Creating event network-changed:764f036a-2fe6-4b66-9ae3-77f17f6b705f for instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 on hv-cinder-85236 Aug 09 16:59:04.269921 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-d52ca23c-e2c0-4587-943e-49d69a84d8c4 req-373998c5-b18d-4304-9b47-5dfbaba9add3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059553 Aug 09 16:59:04.271558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 567/1117] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:59:04.278565 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:04.279448 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:04.289712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.290927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.291598 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:04.292587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.293421 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.294318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:04.579927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:04.586446 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=100 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:04.598088 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-84137357-c04a-403c-bff4-5f4c0f8ef690 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.472785 Aug 09 16:59:04.598814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 551/1118] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:04 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:04.744402 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:04.745337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:04.754139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.758313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.759683 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:04.761967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:04.762674 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:04.765680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.037478 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:05.046833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-bc48e071-ab79-4b84-afcc-d69fc43f5f9e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.306288 Aug 09 16:59:05.059736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 552/1119] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:04 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:05.101004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:05.133749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=6 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:05.149691 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7ffa9e6b-6d1b-44f7-8971-fcb92b16ec07 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-volume_attachments/4d4c1088-ded7-435f-a5e3-6b71a8663f5f" status: 202 len: 0 microversion: 2.20 time: 0.876406 Aug 09 16:59:05.150538 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 568/1120] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Aug 9 16:59:04 2022] DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-volume_attachments/4d4c1088-ded7-435f-a5e3-6b71a8663f5f => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:59:05.268008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:05.269749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:05.281592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:05.283908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:05.285314 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.288038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:05.289456 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:05.290256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.342680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124901) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 16:59:05.631731 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:05.632363 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:05.640287 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:05.641043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:05.642226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.643234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:05.643911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:05.644554 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.734847 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b14b97f2-b492-41f3-9956-7e588e3bef7f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "POST /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/action" status: 202 len: 0 microversion: 2.20 time: 0.471247 Aug 09 16:59:05.753445 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 553/1121] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 9 16:59:05 2022] POST /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:59:05.765343 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:05.768442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:05.786969 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:05.791779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:05.791779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.791779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:05.791779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:05.792198 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:05.911354 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:05.920211 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c5b7b263-b0fd-4b62-9381-cd9d1570135f tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.304253 Aug 09 16:59:05.935773 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 569/1122] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:05 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:06.067353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:06.069464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:06.070590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:06.080034 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:06.084723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:06.084871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:06.084978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:06.084978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:06.085150 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6ec72928-0e8c-4f2b-9be5-988b3601c964 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.325100 Aug 09 16:59:06.085232 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:06.085232 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:06.085232 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:06.086229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 554/1123] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:05 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:06.583638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:06.595832 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-781fb920-6e58-4cbd-b443-2d7dcaadfc06 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.529992 Aug 09 16:59:06.596900 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 570/1124] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:06 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:06.946639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:06.948208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:06.950984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:06.965484 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:06.965998 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:06.966437 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:06.969247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:06.970518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:06.970969 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:07.114047 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:07.114600 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:07.126947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:07.127714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:07.128259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:07.129643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:07.130108 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:07.130732 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:07.134224 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:07.143781 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4cb2c5e0-a5d0-4952-be35-a78397230a64 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.205912 Aug 09 16:59:07.145136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 555/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:06 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:07.280617 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:07.289703 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:07.291479 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:07.292841 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-13e20f41-f75e-4c57-ad0f-1772d65f8c89 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.186587 Aug 09 16:59:07.293761 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 571/1126] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:07 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:07.618055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:07.619080 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:07.626705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:07.627899 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:07.628635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:07.630143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:07.630714 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:07.631600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:07.808810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:07.818616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ce57d60a-e2fd-4b4d-a791-043aa24fac3f tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.204791 Aug 09 16:59:07.819613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 556/1127] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:07 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:08.165580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:08.166148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:08.174615 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:08.175401 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:08.181373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:08.181373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:08.181373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:08.181373 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:08.320146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:08.321438 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:08.331391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:08.335163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:08.335163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:08.335163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:08.335163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:08.335853 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:08.409197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:08.425081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-42f928b9-430e-49e1-bb83-bd5097504a7e tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.262686 Aug 09 16:59:08.439195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 572/1128] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:08 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:08.514693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:08.523568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:08.525211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:08.529451 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2af7efd6-a99d-4869-89a5-fdcddd0a4e44 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.214929 Aug 09 16:59:08.543771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 557/1129] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:08 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:08.843730 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:08.846510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:08.866644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:08.866644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:08.866644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:08.866644 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:08.867181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:08.867181 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:09.042745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:09.050756 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-1513c088-9bb0-4d1c-83e5-f8f59d6f6f1e tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.213156 Aug 09 16:59:09.063153 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 573/1130] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:08 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:09.446164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:09.447859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:09.456645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:09.457435 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:09.458552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:09.459513 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:09.460641 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:09.471630 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:09.556973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:09.557801 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:09.583171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:09.583925 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:09.584618 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:09.585505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:09.586387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:09.587091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:09.670106 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:09.681477 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-10f0800f-3d7a-4f91-bae8-ced5f312d23a tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.238401 Aug 09 16:59:09.682495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 558/1131] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:09 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:09.786775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:09.804481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:09.811579 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:09.816009 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0e504cca-1d94-481e-a0b1-9ef6d60632b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.263609 Aug 09 16:59:09.817915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 574/1132] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:09 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:10.072295 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:10.072964 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:10.079051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:10.079562 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:10.080003 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:10.080698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:10.081160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:10.081597 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:10.218363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:10.227491 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6ae212dc-82bc-476d-9508-aec4b7a35c13 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.159084 Aug 09 16:59:10.228348 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 559/1133] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:10 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:10.705076 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:10.705695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:10.712818 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:10.713200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:10.713688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:10.714563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:10.715070 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:10.715998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:10.789204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-d0424ebf-f004-48d4-a3fb-0aba5fb68d29 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4da5700>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:10.849702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-d0424ebf-f004-48d4-a3fb-0aba5fb68d29 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ab2b6f53-d403-497b-a649-4889089aac4d" status: 200 len: 350 microversion: 2.1 time: 0.064568 Aug 09 16:59:10.850468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 560/1134] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:59:10 2022] GET /compute/v2.1/os-volumes/ab2b6f53-d403-497b-a649-4889089aac4d => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:10.855052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:10.858803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:10.880320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:10.881457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:10.882376 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:10.884574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:10.887428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:10.888090 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:10.981359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:10.997621 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a1c0041b-76df-472a-837c-110c94c39ce4 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.296151 Aug 09 16:59:10.998471 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 575/1135] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:10 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:11.073723 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:11.089987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:11.093828 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:11.095555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a1b42b04-ba60-4b7b-9f50-4f80c7c6c7cd tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.243887 Aug 09 16:59:11.096297 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 561/1136] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:10 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:11.251833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:11.253045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:11.260928 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:11.261934 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:11.262631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:11.263692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:11.264275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:11.264911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:11.420130 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:11.429176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-52efadb1-0ad1-46ad-943a-b863ade799c3 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.183542 Aug 09 16:59:11.429760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 576/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:11 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:12.019585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:12.020201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:12.027120 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:12.029807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:12.029807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:12.029807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:12.029807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:12.030137 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:12.120339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:12.120956 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:12.131632 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:12.132126 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:12.132568 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:12.133280 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:12.133740 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:12.134166 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:12.190645 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:12.203652 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-77f74255-cb4e-49a0-a300-f127785c1fed tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1756 microversion: 2.1 time: 0.187799 Aug 09 16:59:12.204922 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 562/1138] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:12 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:12.287710 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:12.296843 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:12.299210 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:12.300672 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-ba21bd71-34ca-473c-8bf7-eea193ee6eaa tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.184621 Aug 09 16:59:12.301330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 577/1139] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:12 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:59:12.451971 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:12.453602 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:12.460481 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:12.461196 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:12.461887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:12.462698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:12.463392 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:12.464030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:12.612328 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:12.621055 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9cafdcb9-59d8-45cf-8102-b55835046c31 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.172995 Aug 09 16:59:12.621947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 563/1140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:12 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:12.689286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-213f6a3d-74dc-481d-8a57-bcd83b0a25e2 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc50bc790>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:12.773581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-213f6a3d-74dc-481d-8a57-bcd83b0a25e2 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ec9643ec-0d32-4836-a888-8d106bcf0133" status: 200 len: 351 microversion: 2.1 time: 0.089028 Aug 09 16:59:12.775533 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 578/1141] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:59:12 2022] GET /compute/v2.1/os-volumes/ec9643ec-0d32-4836-a888-8d106bcf0133 => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:13.228384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:13.229131 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:13.236046 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:13.236557 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:13.237051 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:13.237999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:13.238468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:13.239040 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:13.325857 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:13.326493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:13.333544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:13.334325 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:13.334970 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:13.335878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:13.336525 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:13.337133 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:13.503206 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:13.547184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-15f79f2a-0bb5-4c34-92fb-76f355eedcbc tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1759 microversion: 2.1 time: 0.310539 Aug 09 16:59:13.547184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 564/1142] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:13 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1759 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:13.558786 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:13.564313 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:13.570200 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:13.571907 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:13.573751 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-67543f61-9c22-4864-aab6-40a369abff27 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.252646 Aug 09 16:59:13.589183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 579/1143] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:13 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:13.642822 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:13.643898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:13.654114 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:13.655410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:13.656139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:13.658858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:13.659571 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:13.660251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:13.814592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:13.823327 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-636cd3ed-73e6-4f73-ac94-44dc2999521b tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.184906 Aug 09 16:59:13.823916 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 565/1144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:13 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:14.514743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-71b9ad28-6efa-4347-9897-0d3f291feac4 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4d0fc10>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:14.568468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-71b9ad28-6efa-4347-9897-0d3f291feac4 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/70cff4b3-74b1-4af0-b019-8be7f8ee2608" status: 200 len: 350 microversion: 2.1 time: 0.055427 Aug 09 16:59:14.575183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 580/1145] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/os-volumes/70cff4b3-74b1-4af0-b019-8be7f8ee2608 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:14.581143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1def755c-b411-4cdc-b835-ca6890d878c3 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4ec84c0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:14.597469 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:14.598689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:14.605657 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:14.606772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:14.607317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:14.608362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:14.608895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:14.609410 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:14.669170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1def755c-b411-4cdc-b835-ca6890d878c3 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092884 Aug 09 16:59:14.669752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 566/1146] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:14.685146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-915bf7c5-725c-4f89-a915-29fdfa5e6900 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4b021f0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:14.761493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:14.773809 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:14.775677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:14.782317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-425e1725-6f34-4ab4-8eb6-ddf57978a415 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.189049 Aug 09 16:59:14.786952 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-915bf7c5-725c-4f89-a915-29fdfa5e6900 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106495 Aug 09 16:59:14.787794 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 567/1147] 10.222.0.59 () {58 vars in 1149 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:14.791809 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 581/1148] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:14.803257 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8af8d369-a4ab-49a5-8b95-4a8174a225a5 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4b7d1f0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:14.844977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:14.845772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:14.853037 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:14.853619 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:14.854872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:14.854872 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:14.855382 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:14.856012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:14.900073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8af8d369-a4ab-49a5-8b95-4a8174a225a5 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.100872 Aug 09 16:59:14.900801 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 568/1149] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:14.917608 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a4d8492a-6c42-43af-afb0-5c8783fefc4e tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4ec8820>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:15.064511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a4d8492a-6c42-43af-afb0-5c8783fefc4e tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150550 Aug 09 16:59:15.098623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 569/1150] 10.222.0.59 () {58 vars in 1167 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:15.125559 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:15.130611 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-eb527170-b502-4604-a571-d7950100c021 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4dd63a0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:15.150462 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f1d24d79-8a3c-4f14-878e-b8e8d1cba8b2 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.309819 Aug 09 16:59:15.151729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 582/1151] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:14 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:15.171745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-7dd00ede-ebcb-4d48-9361-3a0a28e8ae43 req-4c1931a6-22f7-4b48-ae80-866099579e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6d438-7e26-4e3d-a088-ca3312a4d746", "name": "network-vif-plugged", "status": "completed", "tag": "764f036a-2fe6-4b66-9ae3-77f17f6b705f"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:15.183072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7dd00ede-ebcb-4d48-9361-3a0a28e8ae43 req-4c1931a6-22f7-4b48-ae80-866099579e32 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:15.183683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7dd00ede-ebcb-4d48-9361-3a0a28e8ae43 req-4c1931a6-22f7-4b48-ae80-866099579e32 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:15.184187 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-7dd00ede-ebcb-4d48-9361-3a0a28e8ae43 req-4c1931a6-22f7-4b48-ae80-866099579e32 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:15.196338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-7dd00ede-ebcb-4d48-9361-3a0a28e8ae43 req-4c1931a6-22f7-4b48-ae80-866099579e32 service nova] Creating event network-vif-plugged:764f036a-2fe6-4b66-9ae3-77f17f6b705f for instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 on hv-cinder-85236 Aug 09 16:59:15.202359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-7dd00ede-ebcb-4d48-9361-3a0a28e8ae43 req-4c1931a6-22f7-4b48-ae80-866099579e32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034022 Aug 09 16:59:15.203162 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 583/1152] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:59:15.224134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-eb527170-b502-4604-a571-d7950100c021 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099633 Aug 09 16:59:15.224709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 570/1153] 10.222.0.59 () {58 vars in 1170 bytes} [Tue Aug 9 16:59:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:15.240223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-751383e0-f404-416c-b600-bea827989e3a tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4c5a790>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:15.342282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-751383e0-f404-416c-b600-bea827989e3a tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.107698 Aug 09 16:59:15.342855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 584/1154] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Aug 9 16:59:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:15.356785 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e5006dd6-b238-4aab-988e-626412c4aea9 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4da5c10>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:15.465980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e5006dd6-b238-4aab-988e-626412c4aea9 tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.112878 Aug 09 16:59:15.476763 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 571/1155] 10.222.0.59 () {58 vars in 1188 bytes} [Tue Aug 9 16:59:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:15.481071 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b2a02507-2f0d-4fc7-bbd4-d375525cbd1a tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] Calling method '.version_select at 0x7fccc4d419d0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:15.573044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b2a02507-2f0d-4fc7-bbd4-d375525cbd1a tempest-VolumesTestJSON-755015140 tempest-VolumesTestJSON-755015140-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095608 Aug 09 16:59:15.583398 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 585/1156] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Aug 9 16:59:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:15.818730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:15.833914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:15.840967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:15.841545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:15.842047 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:15.842894 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:15.843405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:15.844315 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:15.999225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:16.008351 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:16.012029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:16.012029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-49fc81b9-a7de-4b01-b7a5-9c6496f5c405 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.198387 Aug 09 16:59:16.012029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 572/1157] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:15 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:16.173273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:16.173962 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:16.180729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:16.181275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:16.181718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:16.182677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:16.183148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:16.183580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:16.394737 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:16.404770 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-03484312-b92e-4e85-9d29-9d016674dae9 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1266 microversion: 2.1 time: 0.234905 Aug 09 16:59:16.406072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 586/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:16 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:17.035473 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:17.036086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:17.044360 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:17.045105 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:17.045544 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:17.046296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:17.046752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:17.047200 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:17.427334 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:17.427955 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:17.434877 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:17.435634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:17.436998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:17.439065 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:17.439065 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:17.439400 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:17.488910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:17.497692 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:17.499632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:17.501565 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f59ad9a9-baf5-4af7-a5c5-666fed9fa54b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1672 microversion: 2.20 time: 0.470699 Aug 09 16:59:17.502652 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 573/1159] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:17 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1672 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:17.601871 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:17.609330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-57f9f728-c963-4476-bda5-74f971f8a97d tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1453 microversion: 2.1 time: 0.186744 Aug 09 16:59:17.609897 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 587/1160] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:17 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:59:17.629616 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:17.630235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:17.636166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:17.636649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:17.637082 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:17.637774 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:17.638229 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:17.638658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:17.659983 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:17.792212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:17.800148 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3e01d455-c96c-4c92-9859-b4371a0307c6 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1453 microversion: 2.1 time: 0.174302 Aug 09 16:59:17.800730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 574/1161] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 16:59:17 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1453 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:59:18.526466 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:18.528860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:18.538007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:18.538718 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:18.539420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:18.540134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:18.540638 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:18.541017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:18.788172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:18.797219 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:18.799375 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:18.800952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5c701697-1606-45d2-9c29-32e15221cc41 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.280166 Aug 09 16:59:18.801782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 588/1162] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:18 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:19.826469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:19.827779 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:19.843018 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:19.843810 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:19.845408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:19.846488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:19.847248 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:19.847911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:20.094724 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:20.104410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:20.106448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:20.108143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-aaee07e8-1521-48a9-b2f8-61cccdd3652a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.286163 Aug 09 16:59:20.126829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 575/1163] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:19 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:20.433791 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-55b031ac-5456-4a86-88a5-998f84145d49 req-0c9879c9-a5d3-4412-92ee-a7cf0dd42b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d6d438-7e26-4e3d-a088-ca3312a4d746", "tag": "764f036a-2fe6-4b66-9ae3-77f17f6b705f"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:20.449741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-55b031ac-5456-4a86-88a5-998f84145d49 req-0c9879c9-a5d3-4412-92ee-a7cf0dd42b79 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:20.450543 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-55b031ac-5456-4a86-88a5-998f84145d49 req-0c9879c9-a5d3-4412-92ee-a7cf0dd42b79 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:20.493744 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-55b031ac-5456-4a86-88a5-998f84145d49 req-0c9879c9-a5d3-4412-92ee-a7cf0dd42b79 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:20.558891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-55b031ac-5456-4a86-88a5-998f84145d49 req-0c9879c9-a5d3-4412-92ee-a7cf0dd42b79 service nova] Creating event network-changed:764f036a-2fe6-4b66-9ae3-77f17f6b705f for instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 on hv-cinder-85236 Aug 09 16:59:20.573987 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-55b031ac-5456-4a86-88a5-998f84145d49 req-0c9879c9-a5d3-4412-92ee-a7cf0dd42b79 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144994 Aug 09 16:59:20.611539 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 589/1164] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:21.133260 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:21.134374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:21.146582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:21.147324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:21.150086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:21.150898 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:21.155556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:21.156555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:21.635989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:21.676899 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:21.682308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:21.685772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1620a163-7491-451f-bf79-850bac6a1839 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.557194 Aug 09 16:59:21.691754 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 576/1165] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:21 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:22.719042 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:22.720980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:22.733524 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:22.734308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:22.735308 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:22.736887 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:22.737512 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:22.738203 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:22.987911 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:23.004415 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:23.017257 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:23.023758 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0bc4b20f-6336-42b8-be43-cec3647d268a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.309998 Aug 09 16:59:23.024631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 590/1166] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:22 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:24.047671 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:24.054412 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:24.055760 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:24.056455 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:24.057062 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:24.057946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:24.058639 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:24.059256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:24.342460 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:24.351701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:24.354841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:24.362282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-76a7d526-8284-45f6-a406-9a1fb196ba59 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.318614 Aug 09 16:59:24.363337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 577/1167] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:24 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:25.387167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:25.389299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:25.391919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:25.399875 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:25.400738 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:25.402010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:25.405196 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:25.405854 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:25.407254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:25.657677 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:25.666709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:25.669004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:25.670371 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-765e7459-106a-4e6f-a28d-320dc747359e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.287438 Aug 09 16:59:25.671530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 591/1168] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:25 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:26.702292 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:26.707951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:26.718353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:26.718947 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:26.720917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:26.721743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:26.722305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:26.722802 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:26.880979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:26.890353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:26.892566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:26.905654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3125d543-ffb9-4d3a-a36a-855d9841a359 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.199724 Aug 09 16:59:26.905654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 578/1169] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:26 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:27.925698 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:27.927457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:27.935663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:27.950930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:27.950930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:27.950930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:27.950930 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:27.951420 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:28.086423 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:28.093318 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:28.095249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:28.096564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2f52e429-6ea6-410e-bfb0-1e60dc2d775f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.176169 Aug 09 16:59:28.097136 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 592/1170] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:27 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:29.118708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:29.122305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:29.122305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:29.126153 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:29.126691 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:29.127142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:29.127837 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:29.128291 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:29.128786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:29.261371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:29.269949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:29.271589 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:29.272627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-dad062bc-fb79-4e4d-9733-95f23ec9056a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.157872 Aug 09 16:59:29.273191 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 579/1171] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:29 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:30.296362 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:30.296977 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:30.304351 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:30.308822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:30.308822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:30.308822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:30.308822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:30.309241 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:30.499556 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:30.508225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:30.510353 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:30.512058 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0eec8f9b-5499-4452-91a0-a27b8aac4b43 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.220087 Aug 09 16:59:30.512495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 593/1172] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:30 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:31.538526 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:31.539426 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:31.547660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:31.548471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:31.549831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:31.551299 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:31.552200 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:31.553071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:31.802646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:31.814474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:31.817113 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:31.818740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f64968eb-ac0a-4e18-ac82-ad6b22b6012f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.286019 Aug 09 16:59:31.832555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 580/1173] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:31 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:32.844159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:32.844762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:32.851437 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:32.851926 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:32.852365 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:32.853061 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:32.853515 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:32.853939 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:33.017097 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:33.025774 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:33.027359 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:33.034292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fabfe40b-138b-439f-a3e2-5fd374a106c1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.188303 Aug 09 16:59:33.034292 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 594/1174] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:32 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:34.053489 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:34.054259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:34.060824 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:34.061308 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:34.061739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:34.062467 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:34.062926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:34.063378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:34.199693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:34.208263 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:34.209848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:34.211186 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-34951d17-d5bd-4f43-8a10-04a6b216be08 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.162259 Aug 09 16:59:34.211868 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 581/1175] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:34 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:35.235252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:35.235785 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:35.242526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:35.243012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:35.243498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:35.244385 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:35.244849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:35.245281 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:35.379091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:35.387694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:35.389201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:35.390443 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-422a8264-42da-4430-891d-6c2f541eee0f tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.159253 Aug 09 16:59:35.391013 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 595/1176] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:35 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:36.415012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:36.416259 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:36.423836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:36.425015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:36.425516 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:36.426219 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:36.427041 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:36.427693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:36.573622 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:36.575880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:36.577896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:36.579401 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3db6dce2-f37b-492e-b4e9-b8ceca9f04fb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.169492 Aug 09 16:59:36.580119 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 582/1177] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:36 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:37.016871 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-6fbe7628-8382-4e88-888a-acb61ae2f6f6 req-52488bac-de63-4ecc-b269-f227fb511a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "name": "network-vif-plugged", "status": "completed", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:59:37.032817 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6fbe7628-8382-4e88-888a-acb61ae2f6f6 req-52488bac-de63-4ecc-b269-f227fb511a3b service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:37.034104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6fbe7628-8382-4e88-888a-acb61ae2f6f6 req-52488bac-de63-4ecc-b269-f227fb511a3b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:37.034558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-6fbe7628-8382-4e88-888a-acb61ae2f6f6 req-52488bac-de63-4ecc-b269-f227fb511a3b service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:37.048624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-6fbe7628-8382-4e88-888a-acb61ae2f6f6 req-52488bac-de63-4ecc-b269-f227fb511a3b service nova] Creating event network-vif-plugged:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 16:59:37.056966 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-6fbe7628-8382-4e88-888a-acb61ae2f6f6 req-52488bac-de63-4ecc-b269-f227fb511a3b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044368 Aug 09 16:59:37.058413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 596/1178] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 16:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:59:37.603427 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:37.604242 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:37.611189 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:37.611815 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:37.612527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:37.613284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:37.613855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:37.614330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:37.779871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:37.788526 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:37.790790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:37.792170 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-591dfc9a-6786-443c-bc18-3bd09f62b208 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.192796 Aug 09 16:59:37.803719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 583/1179] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:37 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:38.817944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:38.818845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:38.825904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:38.826591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:38.827025 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:38.827739 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:38.828554 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:38.829068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:38.997764 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:39.008001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:39.015454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:39.015454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8e8be62d-7568-410f-b638-7300191a326e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.198617 Aug 09 16:59:39.015454 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 597/1180] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:38 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:40.034347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:40.034960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:40.041591 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:40.042057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:40.042494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:40.043214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:40.043712 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:40.044126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:40.177985 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:40.186288 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:40.187836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:40.189176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-31486113-904b-46ef-8455-918f01e9a8d8 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.159311 Aug 09 16:59:40.189787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 584/1181] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:40 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:41.213431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:41.214050 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:41.220745 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:41.221882 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:41.222332 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:41.223325 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:41.223792 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:41.224222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:41.365397 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:41.373510 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:41.375144 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:41.376311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e218c177-d354-4d58-abcf-56aaf5b39e0b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.166673 Aug 09 16:59:41.376869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 598/1182] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:41 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:42.399967 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:42.400833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:42.407494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:42.408124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:42.408804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:42.409644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:42.410101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:42.410527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:42.542208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:42.550874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:42.556463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:42.556463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f67d8fd6-4162-463a-ab50-37fca1a8e46a tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.157807 Aug 09 16:59:42.556463 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 585/1183] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:42 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:43.578736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:43.579334 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:43.587436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:43.587917 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:43.588348 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:43.589040 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:43.589487 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:43.589906 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:43.743592 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:43.760487 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:43.760487 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:43.760487 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-13220922-87a6-4c19-aae6-186c0c23de1e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.182766 Aug 09 16:59:43.760903 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 599/1184] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:43 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 16:59:44.781860 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:44.782498 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:44.789615 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:44.790113 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:44.790669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:44.791395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:44.791959 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:44.792383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:44.923138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:44.931506 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:44.933039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:44.934203 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c0c43a48-bb50-4c5b-8c95-ed027d658db7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1730 microversion: 2.20 time: 0.156308 Aug 09 16:59:44.934756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 586/1185] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:44 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 16:59:45.957666 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:59:45.958222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:59:45.964771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:45.965255 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:45.965688 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:45.966380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:59:45.966838 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:59:45.967321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:59:45.971996 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=91 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:59:46.098444 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:46.106369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:46.107953 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:59:46.109092 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f6234cee-2d45-437e-8a08-8a9f8f580f3e tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1717 microversion: 2.20 time: 0.155609 Aug 09 16:59:46.109662 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 600/1186] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 16:59:45 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:00:01.376040 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-609938773", "imageRef": "dcb4f82f-c437-452c-9265-269406d40b69", "flavorRef": "452"}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:01.384820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=15 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:01.385528 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=74 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:01.432684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] validate_networks() for None {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:00:01.706527 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:00:01.706945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:00:01.707474 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:00:01.708883 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:00:01.709311 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:00:01.718369 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:01.718819 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:01.719283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:01.719996 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:01.720442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:01.720857 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:01.737321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Getting quotas for project d5fdbec76c3e43ffa496768ac8e8c460. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:00:01.741608 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Getting quotas for user 643ab3504dbe484e9887d1f0e8ed37d8 and project d5fdbec76c3e43ffa496768ac8e8c460. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:00:01.753159 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:00:01.756110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcb4f82f-c437-452c-9265-269406d40b69',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:00:01.852567 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c73ccae7-3d37-49a4-87cb-76c5745c3755 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480566 Aug 09 17:00:01.853533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 587/1187] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 17:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:00:01.864853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0fb5475c-5484-40d1-98ac-afdc08a10ffc tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:01.866338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0fb5475c-5484-40d1-98ac-afdc08a10ffc tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:01.875361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=19 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:01.876361 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=5 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:01.945768 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0fb5475c-5484-40d1-98ac-afdc08a10ffc tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:01.955919 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0fb5475c-5484-40d1-98ac-afdc08a10ffc tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1214 microversion: 2.1 time: 0.094922 Aug 09 17:00:01.956536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 601/1188] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:01 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:02.978931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-3f56ca4d-9896-404f-86e6-47ecfe720ef7 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:02.979662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-3f56ca4d-9896-404f-86e6-47ecfe720ef7 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:03.035762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-3f56ca4d-9896-404f-86e6-47ecfe720ef7 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:03.045650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-3f56ca4d-9896-404f-86e6-47ecfe720ef7 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1214 microversion: 2.1 time: 0.071640 Aug 09 17:00:03.046212 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 588/1189] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:02 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:00:04.066262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:04.067060 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:04.074430 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:04.074914 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:04.075368 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:04.076064 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:04.076518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:04.076942 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:04.146370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:04.154001 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dc382130-1e84-4385-b57e-8d3f80ab6a70 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1210 microversion: 2.1 time: 0.091993 Aug 09 17:00:04.154507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 602/1190] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:04 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:05.177010 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:05.177660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:05.184701 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:05.185298 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:05.185833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:05.186702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:05.187276 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:05.187766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:05.251566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:05.259970 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-47e0da14-307d-4b3c-a85c-e219afb69c07 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1210 microversion: 2.1 time: 0.087514 Aug 09 17:00:05.260598 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 589/1191] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:05 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:06.281858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:06.283622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:06.291542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:06.292029 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:06.292464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:06.293172 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:06.293625 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:06.294057 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:06.366853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:06.374850 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-28229461-30cd-4d43-b81c-aeaea167a481 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1210 microversion: 2.1 time: 0.097086 Aug 09 17:00:06.375869 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 603/1192] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:06 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:07.395995 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:07.397728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:07.403753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:07.404340 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:07.404851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:07.405628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:07.406166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:07.406601 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:07.543052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:07.546790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-872fece0-b310-489e-a1cb-b3344282f8b3 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1266 microversion: 2.1 time: 0.154681 Aug 09 17:00:07.560856 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 590/1193] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:07 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:08.573468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:08.575846 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:08.589655 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:08.591418 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:08.592422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:08.594325 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:08.594991 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:08.597228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:08.690495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:08.705642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-87a61c31-42e0-4682-8f09-7499bd29521c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1272 microversion: 2.1 time: 0.140835 Aug 09 17:00:08.706674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 604/1194] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:08 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:09.730205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:09.731127 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:09.737652 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:09.738227 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:09.741545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:09.741545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:09.741545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:09.741545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:10.047841 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:10.057457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8af6d0f7-6b9c-4783-a766-003cef8f878e tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.330964 Aug 09 17:00:10.058304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 591/1195] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:09 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:10.496197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-ee32e3c7-2724-464f-b5df-7386eb29f44f req-c516ba3c-b309-438c-a60f-7b0ceac5e6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4216b8ed-8360-4feb-8cee-7a6f4a53ce67", "tag": "4f381bc2-010e-4589-b97c-13fb3ec41038"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:10.515134 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-ee32e3c7-2724-464f-b5df-7386eb29f44f req-c516ba3c-b309-438c-a60f-7b0ceac5e6cc service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:10.515488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-ee32e3c7-2724-464f-b5df-7386eb29f44f req-c516ba3c-b309-438c-a60f-7b0ceac5e6cc service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:10.516027 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-ee32e3c7-2724-464f-b5df-7386eb29f44f req-c516ba3c-b309-438c-a60f-7b0ceac5e6cc service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:10.549229 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-ee32e3c7-2724-464f-b5df-7386eb29f44f req-c516ba3c-b309-438c-a60f-7b0ceac5e6cc service nova] Creating event network-changed:4f381bc2-010e-4589-b97c-13fb3ec41038 for instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 on hv-cinder-85236 Aug 09 17:00:10.555470 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-ee32e3c7-2724-464f-b5df-7386eb29f44f req-c516ba3c-b309-438c-a60f-7b0ceac5e6cc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062954 Aug 09 17:00:10.556086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 605/1196] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:11.079027 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:11.081827 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:11.087556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:11.088245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:11.088757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:11.089541 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:11.090093 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:11.090735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:11.228279 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:11.236042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-adcc4d83-11ca-4eff-bf26-86c60fea39e1 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.161138 Aug 09 17:00:11.236609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 592/1197] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:11 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:12.259083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:12.259824 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:12.264497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:12.272886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:12.273344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:12.273837 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:12.274486 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:12.274944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:12.275407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:12.452279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:12.471590 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-237526b7-a69a-4909-a739-2347edcc756a tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.217664 Aug 09 17:00:12.472547 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 606/1198] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:12 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:13.493910 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:13.495533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:13.499731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:13.501377 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=8 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:13.509783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:13.511165 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:13.512719 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:13.513842 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:13.515234 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:13.516680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:13.701580 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:13.709052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a93a0923-eb4d-413a-9f01-b41a1fdcaadd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.219869 Aug 09 17:00:13.710079 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 593/1199] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:13 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:14.731529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:14.733597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:14.742920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:14.744190 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:14.744504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:14.746239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:14.746879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:14.747994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:14.932222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:14.943660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5b408403-94e9-4204-a7c4-529672f0ad49 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.216753 Aug 09 17:00:14.944432 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 607/1200] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:14 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:00:15.972110 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:15.973623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:15.980139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:15.980839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:15.981268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:15.982080 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:15.982528 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:15.982948 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:16.150796 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:16.160769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-979c812f-54ac-48a2-b84e-6e71b0a5b9b0 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.198066 Aug 09 17:00:16.178455 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 594/1201] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:15 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:17.184582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:17.185478 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:17.192920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:17.193518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:17.193987 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:17.195086 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:17.195654 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:17.196127 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:17.415305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:17.424920 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-0bbd3a2b-6dd3-4c29-86c9-6c9b3fdb5617 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.244936 Aug 09 17:00:17.425895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 608/1202] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:17 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:17.556665 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-646948ee-c9f7-48da-ade3-5cf474871113 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Action: 'create', calling method: .version_select at 0x7fccc4ab6280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1926711182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvwSyDj68Ld9Y5mtqDrjTq/wimV2zgUYAPnO5jzjnK3izGJJDPP3tTNKGOyvJbDmZlsJc07mlAFBv8hgeda7/Kh+4Qqqzw6qBy8WI0k6p2cMx78kk/83gMqBWsyv6AdXQ=="}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:17.572382 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-646948ee-c9f7-48da-ade3-5cf474871113 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Getting quotas for project 907c20a4319c450284e1e6b39107d715. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:00:17.576551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-646948ee-c9f7-48da-ade3-5cf474871113 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Getting quotas for user 983a58cb49b1410792440784cd84a63c and project 907c20a4319c450284e1e6b39107d715. Resources: {'key_pairs'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:00:17.653163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-646948ee-c9f7-48da-ade3-5cf474871113 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.338772 Aug 09 17:00:17.654545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 595/1203] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Aug 9 17:00:17 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:18.450159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:18.450159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:18.469317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:18.469879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:18.470384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:18.471197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:18.471898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:18.472531 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:18.615990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:18.624262 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b2c5f9ff-c3a2-4389-9578-0098bee41418 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.180776 Aug 09 17:00:18.624851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 609/1204] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:18 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:19.033396 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-3a6e9e70-0690-4bd7-bc03-115db95031ee req-a6704199-5746-4411-bb3a-439f2385f04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4216b8ed-8360-4feb-8cee-7a6f4a53ce67", "name": "network-vif-plugged", "status": "completed", "tag": "4f381bc2-010e-4589-b97c-13fb3ec41038"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:19.048757 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-3a6e9e70-0690-4bd7-bc03-115db95031ee req-a6704199-5746-4411-bb3a-439f2385f04c service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:19.049599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-3a6e9e70-0690-4bd7-bc03-115db95031ee req-a6704199-5746-4411-bb3a-439f2385f04c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:19.050300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-3a6e9e70-0690-4bd7-bc03-115db95031ee req-a6704199-5746-4411-bb3a-439f2385f04c service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:19.065314 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-3a6e9e70-0690-4bd7-bc03-115db95031ee req-a6704199-5746-4411-bb3a-439f2385f04c service nova] Creating event network-vif-plugged:4f381bc2-010e-4589-b97c-13fb3ec41038 for instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 on hv-cinder-85236 Aug 09 17:00:19.073183 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-3a6e9e70-0690-4bd7-bc03-115db95031ee req-a6704199-5746-4411-bb3a-439f2385f04c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044626 Aug 09 17:00:19.074944 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 596/1205] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:19.290922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-944191351"}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:19.291488 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:19.299056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:19.299716 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:19.300290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:19.301624 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:19.302945 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:19.303458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:19.491140 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.network.security_group_api [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Removing security group f3de0c48-41f5-4040-845d-389a653a25e5 from port 2934afc2-fa4e-4b03-9b5b-d9457d46077e Aug 09 17:00:19.646778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:19.647518 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:19.655069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:19.656011 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:19.656923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:19.657859 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:19.658529 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:19.659146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:19.867721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:19.876316 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7c3c75a0-d0af-4666-8a98-4788ecf3adda tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.234229 Aug 09 17:00:19.876915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 597/1206] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:19 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:00:20.265212 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8340f4a9-e58b-41c4-8097-5f4fbe9a15e5 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/action" status: 202 len: 0 microversion: 2.1 time: 0.978542 Aug 09 17:00:20.269612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 610/1207] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 17:00:19 2022] POST /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/action => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:00:20.309053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-e0182d4d-442f-4a97-be3a-2e9b4d31e306 req-4d273cc0-deec-4e33-ac9e-c43e0e3bd521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:20.321658 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-e0182d4d-442f-4a97-be3a-2e9b4d31e306 req-4d273cc0-deec-4e33-ac9e-c43e0e3bd521 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:20.322383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-e0182d4d-442f-4a97-be3a-2e9b4d31e306 req-4d273cc0-deec-4e33-ac9e-c43e0e3bd521 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:20.322974 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-e0182d4d-442f-4a97-be3a-2e9b4d31e306 req-4d273cc0-deec-4e33-ac9e-c43e0e3bd521 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:20.337821 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-e0182d4d-442f-4a97-be3a-2e9b4d31e306 req-4d273cc0-deec-4e33-ac9e-c43e0e3bd521 service nova] Creating event network-changed:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 17:00:20.345560 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-e0182d4d-442f-4a97-be3a-2e9b4d31e306 req-4d273cc0-deec-4e33-ac9e-c43e0e3bd521 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040083 Aug 09 17:00:20.346403 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 598/1208] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:00:20.899328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:20.899946 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:20.906286 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:20.906772 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:20.907238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:20.907944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:20.908400 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:20.908829 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:21.163352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:21.176689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b112e72d-5def-4d0a-9ab3-b05b2d9d3fed tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1314 microversion: 2.1 time: 0.280855 Aug 09 17:00:21.177456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 611/1209] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:20 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:22.023964 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:22.024531 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:22.032448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.032931 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.033368 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.034074 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.034522 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.034941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.183698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lazy-loading 'services' on Instance uuid 240e5a5a-5f07-4b5e-b8f1-11d492602c3a {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:00:22.198578 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:22.209456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:22.213675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.214888 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.216947 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.219995 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.220714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.221372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.492872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e8d89383-1cdc-489d-9a18-93d25a32c0c9 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments/8b4518f4-e731-4689-8bab-9fa40a28905f" status: 202 len: 0 microversion: 2.1 time: 0.474202 Aug 09 17:00:22.495820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 599/1210] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 17:00:22 2022] DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments/8b4518f4-e731-4689-8bab-9fa40a28905f => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:00:22.502950 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-c392db40-5200-466f-95f9-dc3e29548cdc req-b7c40e5e-5f49-49bb-a582-99c7ab565b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:22.517687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-c392db40-5200-466f-95f9-dc3e29548cdc req-b7c40e5e-5f49-49bb-a582-99c7ab565b72 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.518635 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-c392db40-5200-466f-95f9-dc3e29548cdc req-b7c40e5e-5f49-49bb-a582-99c7ab565b72 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.522708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-c392db40-5200-466f-95f9-dc3e29548cdc req-b7c40e5e-5f49-49bb-a582-99c7ab565b72 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.555599 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-c392db40-5200-466f-95f9-dc3e29548cdc req-b7c40e5e-5f49-49bb-a582-99c7ab565b72 service nova] Creating event network-changed:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 17:00:22.562454 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-c392db40-5200-466f-95f9-dc3e29548cdc req-b7c40e5e-5f49-49bb-a582-99c7ab565b72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064607 Aug 09 17:00:22.563890 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 600/1211] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:22.571832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:22.575655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:22.582777 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.583597 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.584204 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.585353 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.586028 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.586619 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.603019 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:22.611950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4e22adf7-dbbd-44d7-aa43-66491332676d tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1464 microversion: 2.1 time: 0.417004 Aug 09 17:00:22.612989 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 612/1212] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:22 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1464 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:22.639490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e9a4b2b4-6449-461b-876a-7d8a211d58c1 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072883 Aug 09 17:00:22.640495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 601/1213] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 17:00:22 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:22.704557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:22.705095 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:22.716636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.718709 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.723689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.724581 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:22.725070 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:22.728167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:22.818842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:00:23.178380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-abe478db-1230-47bb-aeb8-fe8525b9f42b tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 204 len: 0 microversion: 2.1 time: 0.478427 Aug 09 17:00:23.190876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 613/1214] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 17:00:22 2022] DELETE /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:00:23.191665 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:23.192812 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:23.203831 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:23.204417 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:23.205101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:23.206057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:23.215820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:23.215820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:23.370410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:23.381862 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8ea2249d-48e1-4eb6-8fef-45506c9b6ceb tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1470 microversion: 2.1 time: 0.197003 Aug 09 17:00:23.383705 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 602/1215] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:23 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:23.659322 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:23.662107 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:23.669433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:23.669851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:23.670355 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:23.671041 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:23.671475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:23.671924 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:23.703763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-cb121e16-9a55-4189-a3c3-b566d0efefdf tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052739 Aug 09 17:00:23.704346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 614/1216] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 17:00:23 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:24.402742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:24.403442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:24.411367 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:24.412088 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:24.412628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:24.413574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:24.414163 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:24.414687 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:24.565840 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:24.574603 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a08ec89c-15e5-4d33-95be-3babeb756349 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1470 microversion: 2.1 time: 0.175517 Aug 09 17:00:24.575139 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 603/1217] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:24 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:24.716609 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:24.718742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:24.725294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:24.725776 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:24.726216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:24.726912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:24.727394 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:24.727822 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:24.757341 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-06158ce5-2f14-4155-83fc-0ccdf24e314d tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Aug 09 17:00:24.758131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 615/1218] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 17:00:24 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:25.597094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:25.597753 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:25.604270 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:25.604747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:25.605179 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:25.605861 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:25.606313 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:25.606731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:25.771729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:25.773860 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:25.780370 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:25.785960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:25.785960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:25.785960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:25.785960 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:25.786352 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:25.813570 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f0b74730-43cb-4521-80cf-e7d6d32ae0a8 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Aug 09 17:00:25.814210 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 616/1219] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 17:00:25 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:25.992115 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:25.999605 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-70aa72f0-b438-4ec5-bb9a-a6f429e13181 tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1470 microversion: 2.1 time: 0.406791 Aug 09 17:00:26.000172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 604/1220] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:25 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:26.733652 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-625d8e21-e414-4b3d-87bf-2c1590edfae2 req-556f1708-7ae4-4378-b84b-4b01eae93779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4216b8ed-8360-4feb-8cee-7a6f4a53ce67", "name": "network-vif-deleted", "tag": "4f381bc2-010e-4589-b97c-13fb3ec41038"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:26.745254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-625d8e21-e414-4b3d-87bf-2c1590edfae2 req-556f1708-7ae4-4378-b84b-4b01eae93779 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:26.745753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-625d8e21-e414-4b3d-87bf-2c1590edfae2 req-556f1708-7ae4-4378-b84b-4b01eae93779 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:26.746225 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-625d8e21-e414-4b3d-87bf-2c1590edfae2 req-556f1708-7ae4-4378-b84b-4b01eae93779 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:26.764413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-625d8e21-e414-4b3d-87bf-2c1590edfae2 req-556f1708-7ae4-4378-b84b-4b01eae93779 service nova] Creating event network-vif-deleted:4f381bc2-010e-4589-b97c-13fb3ec41038 for instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 on hv-cinder-85236 Aug 09 17:00:26.769319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-625d8e21-e414-4b3d-87bf-2c1590edfae2 req-556f1708-7ae4-4378-b84b-4b01eae93779 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040330 Aug 09 17:00:26.770683 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 617/1221] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:26.826370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:26.828700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:26.837867 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:26.842990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:26.842990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:26.842990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:26.842990 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:26.843453 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:26.882762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8e63f5bb-a98e-4103-8b63-13e43c1b0800 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057103 Aug 09 17:00:26.882762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 605/1222] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 9 17:00:26 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 17:00:26.892111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:26.892697 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:26.899036 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:26.899564 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:26.900005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:26.900719 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:26.901207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:26.901637 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:26.920245 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:27.006588 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] HTTP exception thrown: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a is not attached to volume 8b4518f4-e731-4689-8bab-9fa40a28905f Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Request method failure captured: Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments/8b4518f4-e731-4689-8bab-9fa40a28905f HTTP/1.1 Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pHdLwYbKJ6K2xpivlJdDTUgb2CoSHZmtxxH_5KX79mEmnN3E3YPJrlcaJoljpPamSv7J0V_1cGys9lJEZDeAN09SftTA1MUh1Wwl1Zng56ROlIQHSe_VXNm_e0H-iRhjo8MYsvCFUryLgKW9pv-MdmowNHRb0e4J0knx10ZJcFAtuE Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 7ffda0edbe694650b9de23928f1de1a4 Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-TestMinimumBasicScenario-1223273945 Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 17:00:27.018973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ffda0edbe694650b9de23928f1de1a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7ffda0edbe694650b9de23928f1de1a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7ffda0edbe694650b9de23928f1de1a4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ffda0edbe694650b9de23928f1de1a4"}]}] Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-TestMinimumBasicScenario-1223273945 Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 7ffda0edbe694650b9de23928f1de1a4 Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1223273945 Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-TestMinimumBasicScenario-1223273945-project Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: b43cc0a86fed444daacd9194a0ad1a1b Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-TestMinimumBasicScenario-1223273945-project Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 17:00:27.021587 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a is not attached to volume 8b4518f4-e731-4689-8bab-9fa40a28905f Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'server_id': '240e5a5a-5f07-4b5e-b8f1-11d492602c3a', 'id': '8b4518f4-e731-4689-8bab-9fa40a28905f'} Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8b4518f4-e731-4689-8bab-9fa40a28905f. Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:27.022612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a is not attached to volume 8b4518f4-e731-4689-8bab-9fa40a28905f Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a is not attached to volume 8b4518f4-e731-4689-8bab-9fa40a28905f Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:27.024188 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Returning 404 to user: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a is not attached to volume 8b4518f4-e731-4689-8bab-9fa40a28905f {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:27.025431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fce1abcd-4a8b-4e74-9306-b00dc46537be tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments/8b4518f4-e731-4689-8bab-9fa40a28905f" status: 404 len: 154 microversion: 2.1 time: 0.124081 Aug 09 17:00:27.025431 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 618/1223] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 9 17:00:26 2022] DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a/os-volume_attachments/8b4518f4-e731-4689-8bab-9fa40a28905f => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:00:27.025746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:27.025746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:27.030745 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:27.031317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:27.031766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:27.032750 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:27.033030 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:27.033464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:27.112334 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:27.120304 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4729b07c-cfda-461e-ad97-e5ee55eee67c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1299 microversion: 2.1 time: 0.102497 Aug 09 17:00:27.120677 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 606/1224] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:27 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:00:28.140967 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:28.149369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:28.149369 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.149585 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.149975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:28.150675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.151179 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.151607 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:28.186473 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.186951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.187419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:28.187866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lazy-loading 'fault' on Instance uuid 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:00:28.294516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '643ab3504dbe484e9887d1f0e8ed37d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fdbec76c3e43ffa496768ac8e8c460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:28.294516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a3d72394-a9bc-45a6-8286-e8f5d555167c tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 200 len: 1304 microversion: 2.1 time: 0.156233 Aug 09 17:00:28.294516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 619/1225] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:28 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:28.419199 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:28.419715 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:28.421820 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=4 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:28.427235 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.427721 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.428166 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:28.428886 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.429342 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.429769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:28.447968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:28.455201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:00:28.852076 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e99e72d8-bffc-497c-a962-87c9d9764e72 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 204 len: 0 microversion: 2.1 time: 0.436348 Aug 09 17:00:28.852590 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 607/1226] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 17:00:28 2022] DELETE /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:00:28.860842 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:28.861964 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:28.869342 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.869833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.870274 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:28.871008 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:28.871574 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:28.872012 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:29.012743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:29.021514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-a7306e93-c504-4203-b924-8edbb839afc2 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1555 microversion: 2.1 time: 0.164385 Aug 09 17:00:29.022091 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 620/1227] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:28 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:29.318366 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:29.319073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] [instance: 4216b8ed-8360-4feb-8cee-7a6f4a53ce67] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:29.325404 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:29.325888 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:29.326326 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:29.327020 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:29.327494 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:29.327920 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:29.342305 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] HTTP exception thrown: Instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 could not be found. Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Request method failure captured: Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 HTTP/1.1 Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pKOZoRKSD-lCx1HdkFsX1aFoFq9kimAPRFbD08mn4boGzEaR7d8oUp9M_sbjnWnGeaAcMnyvvRBLCqd8CXC4iEdkHqBpQjP9tEwmwrONIAre_b_oNyKebOxTKMBNfjgUHZAN66E9KTfhQ3tTim5FpwXurnU9WiMwRcLCnQY9vv-wxM Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: d5fdbec76c3e43ffa496768ac8e8c460 Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-VolumesNegativeTest-343416619 Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:00:29.344071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5fdbec76c3e43ffa496768ac8e8c460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d5fdbec76c3e43ffa496768ac8e8c460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d5fdbec76c3e43ffa496768ac8e8c460", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d5fdbec76c3e43ffa496768ac8e8c460"}]}] Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-VolumesNegativeTest-343416619 Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: d5fdbec76c3e43ffa496768ac8e8c460 Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-VolumesNegativeTest-343416619 Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-VolumesNegativeTest-343416619-project Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 643ab3504dbe484e9887d1f0e8ed37d8 Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-VolumesNegativeTest-343416619-project Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 could not be found. Aug 09 17:00:29.345655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '4216b8ed-8360-4feb-8cee-7a6f4a53ce67'} Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 could not be found. Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:29.346708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 could not be found. Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 could not be found. Aug 09 17:00:29.348320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:29.350457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] Returning 404 to user: Instance 4216b8ed-8360-4feb-8cee-7a6f4a53ce67 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:29.351363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-53109e0a-0429-4801-bf0e-971d9949acbd tempest-VolumesNegativeTest-343416619 tempest-VolumesNegativeTest-343416619-project] 10.222.0.59 "GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67" status: 404 len: 111 microversion: 2.1 time: 0.037991 Aug 09 17:00:29.352094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 608/1228] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:29 2022] GET /compute/v2.1/servers/4216b8ed-8360-4feb-8cee-7a6f4a53ce67 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:00:30.041799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:30.042440 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:30.049022 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:30.049567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:30.050011 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:30.051317 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:30.051789 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:30.052257 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:30.193577 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:30.202408 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5f2d66bb-aea6-4883-ba25-af4ed9554e56 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1555 microversion: 2.1 time: 0.164438 Aug 09 17:00:30.203026 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 621/1229] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:30 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:31.225184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:31.225926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:31.237989 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:31.239858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:31.240787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:31.242087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:31.242923 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:31.243874 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:31.408911 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:31.417223 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-f8917606-7e04-4c6f-ad1f-7de7ab34c155 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1555 microversion: 2.1 time: 0.197668 Aug 09 17:00:31.417791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 609/1230] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:31 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1555 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:32.440699 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:32.451059 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:32.471307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:32.471307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:32.471307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:32.471307 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:32.471853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:32.471853 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:32.583052 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-ea5a2ab8-bf05-44dc-b40f-73c16795e1db req-1e800ac5-df89-4d07-8b9d-a9d173efd6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240e5a5a-5f07-4b5e-b8f1-11d492602c3a", "name": "network-vif-deleted", "tag": "2934afc2-fa4e-4b03-9b5b-d9457d46077e"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:32.595581 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:32.604822 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-ea5a2ab8-bf05-44dc-b40f-73c16795e1db req-1e800ac5-df89-4d07-8b9d-a9d173efd6ae service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:32.609201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-ea5a2ab8-bf05-44dc-b40f-73c16795e1db req-1e800ac5-df89-4d07-8b9d-a9d173efd6ae service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:32.609660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-ea5a2ab8-bf05-44dc-b40f-73c16795e1db req-1e800ac5-df89-4d07-8b9d-a9d173efd6ae service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:32.627730 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-ea5a2ab8-bf05-44dc-b40f-73c16795e1db req-1e800ac5-df89-4d07-8b9d-a9d173efd6ae service nova] Creating event network-vif-deleted:2934afc2-fa4e-4b03-9b5b-d9457d46077e for instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a on hv-cinder-85236 Aug 09 17:00:32.635198 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:32.644332 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-ea5a2ab8-bf05-44dc-b40f-73c16795e1db req-1e800ac5-df89-4d07-8b9d-a9d173efd6ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071963 Aug 09 17:00:32.645165 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4a8de431-81cc-4b28-8b8f-cfa8047aa139 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1513 microversion: 2.1 time: 0.210390 Aug 09 17:00:32.646104 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 610/1231] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:00:32.646490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 622/1232] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:32 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:33.668493 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:33.670048 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:33.678552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:33.679284 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:33.679731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:33.680442 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:33.680896 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:33.681563 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:33.720778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:33.721427 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:33.721986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:33.722449 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lazy-loading 'fault' on Instance uuid 240e5a5a-5f07-4b5e-b8f1-11d492602c3a {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:00:33.772380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b43cc0a86fed444daacd9194a0ad1a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ffda0edbe694650b9de23928f1de1a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:33.784748 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-ef025130-6705-4ba7-80df-165bf8d47d22 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 200 len: 1349 microversion: 2.1 time: 0.120604 Aug 09 17:00:33.786778 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 611/1233] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:33 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 1349 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:34.808633 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:34.809311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] [instance: 240e5a5a-5f07-4b5e-b8f1-11d492602c3a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:34.813267 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:34.816755 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:34.817464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:34.818261 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:34.819079 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:34.819567 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:34.820117 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:34.835950 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] HTTP exception thrown: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a could not be found. Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Request method failure captured: Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a HTTP/1.1 Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pHdLwYbKJ6K2xpivlJdDTUgb2CoSHZmtxxH_5KX79mEmnN3E3YPJrlcaJoljpPamSv7J0V_1cGys9lJEZDeAN09SftTA1MUh1Wwl1Zng56ROlIQHSe_VXNm_e0H-iRhjo8MYsvCFUryLgKW9pv-MdmowNHRb0e4J0knx10ZJcFAtuE Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 7ffda0edbe694650b9de23928f1de1a4 Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-TestMinimumBasicScenario-1223273945 Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 17:00:34.837580 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ffda0edbe694650b9de23928f1de1a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7ffda0edbe694650b9de23928f1de1a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7ffda0edbe694650b9de23928f1de1a4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7ffda0edbe694650b9de23928f1de1a4"}]}] Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-TestMinimumBasicScenario-1223273945 Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 7ffda0edbe694650b9de23928f1de1a4 Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1223273945 Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-TestMinimumBasicScenario-1223273945-project Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: b43cc0a86fed444daacd9194a0ad1a1b Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-TestMinimumBasicScenario-1223273945-project Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a could not be found. Aug 09 17:00:34.839304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '240e5a5a-5f07-4b5e-b8f1-11d492602c3a'} Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a could not be found. Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:34.840269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a could not be found. Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a could not be found. Aug 09 17:00:34.841898 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:34.843227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Returning 404 to user: Instance 240e5a5a-5f07-4b5e-b8f1-11d492602c3a could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:34.843227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3038aa13-9b8a-44a8-b4a0-9c1fff7f3239 tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a" status: 404 len: 111 microversion: 2.1 time: 0.034633 Aug 09 17:00:34.843227 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 623/1234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:34 2022] GET /compute/v2.1/servers/240e5a5a-5f07-4b5e-b8f1-11d492602c3a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:00:34.850742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2de8dc15-0ddb-4105-a912-29739183a67c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] Calling method '.version_select at 0x7fccc4ec8700>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:34.927928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2de8dc15-0ddb-4105-a912-29739183a67c tempest-TestMinimumBasicScenario-1223273945 tempest-TestMinimumBasicScenario-1223273945-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1215183523" status: 202 len: 0 microversion: 2.1 time: 0.077885 Aug 09 17:00:34.927928 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 612/1235] 10.222.0.59 () {58 vars in 1272 bytes} [Tue Aug 9 17:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1215183523 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:00:36.667891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:36.670468 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:36.678082 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:36.678675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:36.679327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:36.680131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:36.680650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:36.681311 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:36.721741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d8bce7d8-60fe-41eb-88b8-25876fc9b6b6 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060352 Aug 09 17:00:36.722879 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 624/1236] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 9 17:00:36 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:36.800908 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:36.805762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:36.814769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:36.816836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:36.817613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:36.819887 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:36.821872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:36.822533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:36.857407 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:00:37.180948 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:00:37.181222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Tue Aug 9 17:00:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:00:37.212081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-cfc865b7-9d69-4538-bd14-068198f3e965 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 204 len: 0 microversion: 2.20 time: 0.414808 Aug 09 17:00:37.213100 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 613/1237] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 17:00:36 2022] DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:00:37.221527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:37.222161 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:37.228675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:37.229155 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:37.229586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:37.230278 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:37.230760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:37.231217 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:37.470826 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:37.479276 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:37.480794 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:37.481981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3d5153c6-a7f4-4a3e-8bd6-0f4dd801cae7 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.264831 Aug 09 17:00:37.482545 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 625/1238] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:37 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:00:38.506476 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:38.507209 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:38.514026 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:38.514511 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:38.514941 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:38.515870 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:38.516323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:38.516742 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:38.710582 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:38.721285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:38.722450 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:38.724669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-90967a9b-c393-485b-bcda-8b2f0c511707 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.222461 Aug 09 17:00:38.725237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 614/1239] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:38 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:00:39.753148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:39.754681 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:39.764215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:39.764845 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:39.765385 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:39.766324 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:39.766908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:39.767461 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:40.043844 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:40.052014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:40.053656 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:40.054861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5e495183-0cbf-4fce-b304-39a66c539675 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1723 microversion: 2.20 time: 0.309125 Aug 09 17:00:40.060463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 626/1240] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:39 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:00:40.682403 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-83f4505a-b99d-46e3-b16b-a0dde46dc3cf req-4464c3ff-dea0-4a7b-86b4-f968ba653c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfd8cd7-c54d-4820-8b0c-ba06394e2714", "name": "network-vif-deleted", "tag": "1443cf52-7171-4d1e-804b-b93c2c70b8e8"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:40.686374 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-83f4505a-b99d-46e3-b16b-a0dde46dc3cf req-4464c3ff-dea0-4a7b-86b4-f968ba653c97 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:40.687025 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-83f4505a-b99d-46e3-b16b-a0dde46dc3cf req-4464c3ff-dea0-4a7b-86b4-f968ba653c97 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:40.687660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-83f4505a-b99d-46e3-b16b-a0dde46dc3cf req-4464c3ff-dea0-4a7b-86b4-f968ba653c97 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:40.700390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-83f4505a-b99d-46e3-b16b-a0dde46dc3cf req-4464c3ff-dea0-4a7b-86b4-f968ba653c97 service nova] Creating event network-vif-deleted:1443cf52-7171-4d1e-804b-b93c2c70b8e8 for instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 on hv-cinder-85236 Aug 09 17:00:40.705729 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-83f4505a-b99d-46e3-b16b-a0dde46dc3cf req-4464c3ff-dea0-4a7b-86b4-f968ba653c97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034990 Aug 09 17:00:40.709815 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 615/1241] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:41.087194 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:41.091407 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:41.105804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:41.105804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:41.105804 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:41.107062 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:41.107700 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:41.108285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:41.168186 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:41.169305 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:41.170161 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:41.170814 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lazy-loading 'fault' on Instance uuid 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:00:41.241460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:41.241460 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:41.242909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d14469e54946bdb18bafbbed738f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432f91c6e89c4fecb0d1f6afb1bcfe7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:41.244103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dbdf0f12-34db-40f3-8f44-00c2fa7f8aa5 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 200 len: 1371 microversion: 2.20 time: 0.165965 Aug 09 17:00:41.244753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 627/1242] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:41 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 17:00:42.271092 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:42.271935 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:42.278993 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:42.279572 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:42.280015 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:42.280725 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:42.281303 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:42.281688 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:42.303749 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] HTTP exception thrown: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Request method failure captured: Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 HTTP/1.1 Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pDGfqaVHhn4nROlGEjulu0u-Y9HPehygGZ2X3vbBrN5hPFMFi_fRIvIGr-3fihY0Ib1IQaResdNvKoMhYm-M-DvvQBTHa_xml4zcYMBV-QgHmD2RvSRLG7zwFJXkYpMcFhEFebc13WUldNVpRXMRR4Sh7vKwPDUfLcciBA02z996gI Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:00:42.305736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_432f91c6e89c4fecb0d1f6afb1bcfe7e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}] Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 35d14469e54946bdb18bafbbed738f37 Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:42.307659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '7cfd8cd7-c54d-4820-8b0c-ba06394e2714'} Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:42.308791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:42.310468 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:42.312926 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Returning 404 to user: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:42.313968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e86e522d-ba00-410f-8aca-08438f42d299 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 404 len: 111 microversion: 2.20 time: 0.049474 Aug 09 17:00:42.326427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-799e407f-b4bf-471b-84e2-57c44bc7f4eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '.version_select at 0x7fccc9527820>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:42.335201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 616/1243] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:42 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 17:00:42.487114 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-799e407f-b4bf-471b-84e2-57c44bc7f4eb tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-637665454" status: 204 len: 0 microversion: 2.20 time: 0.166121 Aug 09 17:00:42.491909 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 628/1244] 10.222.0.59 () {60 vars in 1259 bytes} [Tue Aug 9 17:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-637665454 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 17:00:42.548363 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-406461301", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1926711182", "security_groups": [{"name": "tempest-secgroup-smoke-1820280548"}], "networks": [{"uuid": "16b7cf6d-d031-48e2-96f0-440212fd98f8"}], "block_device_mapping_v2": [{"uuid": "6cbd00a2-60f6-4db6-9aa0-1a2087d6e083", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:42.748087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.network.neutron [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] validate_networks() for [('16b7cf6d-d031-48e2-96f0-440212fd98f8', None, None, None, None, None)] {{(pid=124901) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 17:00:43.782047 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Flavor limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 17:00:43.792070 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Image limits 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 17:00:43.792766 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Flavor pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 17:00:43.793650 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Image pref 0:0:0 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 17:00:43.794086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.virt.hardware [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124901) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 17:00:43.811558 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:43.812039 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:43.812472 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:43.813193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:43.813648 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:43.814068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:43.859844 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Getting quotas for project 907c20a4319c450284e1e6b39107d715. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 17:00:43.871900 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.quota [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Getting quotas for user 983a58cb49b1410792440784cd84a63c and project 907c20a4319c450284e1e6b39107d715. Resources: {'instances', 'cores', 'ram'} {{(pid=124901) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 17:00:43.989225 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Going to run 1 instances... {{(pid=124901) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 17:00:43.993087 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cbd00a2-60f6-4db6-9aa0-1a2087d6e083',volume_size=None,volume_type=None)] {{(pid=124901) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 17:00:44.826253 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-da487022-fcb4-499d-a16b-bf2e732062d9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.283584 Aug 09 17:00:44.826917 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 617/1245] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 9 17:00:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 17:00:44.842247 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-971a426b-6a76-405f-9561-ae2bfed9e119 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:44.844103 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-971a426b-6a76-405f-9561-ae2bfed9e119 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:44.921422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-971a426b-6a76-405f-9561-ae2bfed9e119 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:44.932775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-971a426b-6a76-405f-9561-ae2bfed9e119 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1088 microversion: 2.1 time: 0.097949 Aug 09 17:00:44.933364 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 629/1246] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:44 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:45.352455 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:45.352955 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:45.359331 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:45.359823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:45.360265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:45.361000 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:45.361453 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:45.361881 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:45.376422 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] HTTP exception thrown: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Request method failure captured: Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 HTTP/1.1 Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pDGfqaVHhn4nROlGEjulu0u-Y9HPehygGZ2X3vbBrN5hPFMFi_fRIvIGr-3fihY0Ib1IQaResdNvKoMhYm-M-DvvQBTHa_xml4zcYMBV-QgHmD2RvSRLG7zwFJXkYpMcFhEFebc13WUldNVpRXMRR4Sh7vKwPDUfLcciBA02z996gI Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:00:45.377988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_432f91c6e89c4fecb0d1f6afb1bcfe7e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}] Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 35d14469e54946bdb18bafbbed738f37 Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.380056 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': '7cfd8cd7-c54d-4820-8b0c-ba06394e2714'} Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:45.381101 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.382698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.384285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Returning 404 to user: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:45.384285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8886489b-24fa-40e0-9fef-f1970336ada1 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 404 len: 111 microversion: 2.20 time: 0.032227 Aug 09 17:00:45.384285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 618/1247] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 17:00:45 2022] DELETE /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:00:45.388944 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:45.389823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: 7cfd8cd7-c54d-4820-8b0c-ba06394e2714] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:45.397223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:45.397999 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:45.398612 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:45.399714 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:45.400378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:45.401013 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:45.420659 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] HTTP exception thrown: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Request method failure captured: Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 HTTP/1.1 Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pDGfqaVHhn4nROlGEjulu0u-Y9HPehygGZ2X3vbBrN5hPFMFi_fRIvIGr-3fihY0Ib1IQaResdNvKoMhYm-M-DvvQBTHa_xml4zcYMBV-QgHmD2RvSRLG7zwFJXkYpMcFhEFebc13WUldNVpRXMRR4Sh7vKwPDUfLcciBA02z996gI Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 17:00:45.422226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_432f91c6e89c4fecb0d1f6afb1bcfe7e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}] Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 35d14469e54946bdb18bafbbed738f37 Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.424032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '7cfd8cd7-c54d-4820-8b0c-ba06394e2714'} Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:45.424976 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. Aug 09 17:00:45.427304 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:45.429005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Returning 404 to user: Instance 7cfd8cd7-c54d-4820-8b0c-ba06394e2714 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:45.429005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8fb9d009-bf46-42ec-8bf7-8cc4086e9396 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714" status: 404 len: 111 microversion: 2.20 time: 0.039316 Aug 09 17:00:45.429005 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 630/1248] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:45 2022] GET /compute/v2.1/servers/7cfd8cd7-c54d-4820-8b0c-ba06394e2714 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:00:45.954464 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a2e0b4d3-b096-421e-bc03-31e9215fb29e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:45.955085 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a2e0b4d3-b096-421e-bc03-31e9215fb29e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:46.022891 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a2e0b4d3-b096-421e-bc03-31e9215fb29e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:46.029804 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a2e0b4d3-b096-421e-bc03-31e9215fb29e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1088 microversion: 2.1 time: 0.079645 Aug 09 17:00:46.030380 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 619/1249] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:45 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:46.836147 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:46.837252 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:46.845125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:46.849098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:46.849098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:46.849098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:46.849098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:46.849884 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:46.865214 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] HTTP exception thrown: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Request method failure captured: Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a HTTP/1.1 Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pDGfqaVHhn4nROlGEjulu0u-Y9HPehygGZ2X3vbBrN5hPFMFi_fRIvIGr-3fihY0Ib1IQaResdNvKoMhYm-M-DvvQBTHa_xml4zcYMBV-QgHmD2RvSRLG7zwFJXkYpMcFhEFebc13WUldNVpRXMRR4Sh7vKwPDUfLcciBA02z996gI Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 17:00:46.866833 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_432f91c6e89c4fecb0d1f6afb1bcfe7e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}] Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 35d14469e54946bdb18bafbbed738f37 Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.873436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'da7f4d33-f0b3-4448-9f68-813a5aead47a'} Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:46.874384 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.875980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.877753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Returning 404 to user: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:46.877753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f129b8c4-41e2-46ab-be71-71849abc6881 tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 404 len: 111 microversion: 2.20 time: 0.036391 Aug 09 17:00:46.877753 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 631/1250] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 9 17:00:46 2022] DELETE /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:00:46.878038 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:46.879428 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] [instance: da7f4d33-f0b3-4448-9f68-813a5aead47a] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:46.889306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:46.891012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:46.891012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:46.891012 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:46.891425 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:46.891848 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:46.905107 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] HTTP exception thrown: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Request method failure captured: Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a HTTP/1.1 Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pDGfqaVHhn4nROlGEjulu0u-Y9HPehygGZ2X3vbBrN5hPFMFi_fRIvIGr-3fihY0Ib1IQaResdNvKoMhYm-M-DvvQBTHa_xml4zcYMBV-QgHmD2RvSRLG7zwFJXkYpMcFhEFebc13WUldNVpRXMRR4Sh7vKwPDUfLcciBA02z996gI Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:00:46.906698 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_432f91c6e89c4fecb0d1f6afb1bcfe7e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/432f91c6e89c4fecb0d1f6afb1bcfe7e"}]}] Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 432f91c6e89c4fecb0d1f6afb1bcfe7e Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-906113593 Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 35d14469e54946bdb18bafbbed738f37 Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-AttachVolumeShelveTestJSON-906113593-project Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.913902 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'da7f4d33-f0b3-4448-9f68-813a5aead47a'} Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:00:46.914968 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. Aug 09 17:00:46.916592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:00:46.918083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] Returning 404 to user: Instance da7f4d33-f0b3-4448-9f68-813a5aead47a could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:00:46.918083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9b48cc5b-6e08-4d70-86bc-d2af2111792b tempest-AttachVolumeShelveTestJSON-906113593 tempest-AttachVolumeShelveTestJSON-906113593-project] 10.222.0.59 "GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a" status: 404 len: 111 microversion: 2.20 time: 0.034565 Aug 09 17:00:46.918083 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 620/1251] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 9 17:00:46 2022] GET /compute/v2.1/servers/da7f4d33-f0b3-4448-9f68-813a5aead47a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 17:00:47.052327 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:47.053014 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:47.059233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:47.059741 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:47.060392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:47.061104 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:47.061563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:47.062230 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:47.138536 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:47.147396 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-031b91cb-24ea-48bc-9ed2-18859b80453b tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1186 microversion: 2.1 time: 0.099715 Aug 09 17:00:47.148319 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 632/1252] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:47 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:48.173708 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:48.174571 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:48.183059 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:48.183585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:48.184029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:48.184836 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:48.185330 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:48.185684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:48.323077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:48.333395 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-39367cf4-a26e-4ef4-8d63-2fb1516b53a2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1204 microversion: 2.1 time: 0.164806 Aug 09 17:00:48.334086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 621/1253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:48 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1204 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:49.354723 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:49.355388 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:49.362002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:49.362493 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:49.362957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:49.364263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:49.364721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:49.365154 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:49.610936 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:49.646295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-820c2368-15cf-4736-ab1f-daa132069fb6 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1272 microversion: 2.1 time: 0.286663 Aug 09 17:00:49.662123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 633/1254] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:49 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1272 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:50.606273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-77bb9288-3227-41cf-bf90-d3d15ca769d8 req-c46e3bf6-dce5-4f8c-9a84-12babf9c1b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:00:50.627479 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-77bb9288-3227-41cf-bf90-d3d15ca769d8 req-c46e3bf6-dce5-4f8c-9a84-12babf9c1b58 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:50.630627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-77bb9288-3227-41cf-bf90-d3d15ca769d8 req-c46e3bf6-dce5-4f8c-9a84-12babf9c1b58 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:50.631364 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-77bb9288-3227-41cf-bf90-d3d15ca769d8 req-c46e3bf6-dce5-4f8c-9a84-12babf9c1b58 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:50.657823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-77bb9288-3227-41cf-bf90-d3d15ca769d8 req-c46e3bf6-dce5-4f8c-9a84-12babf9c1b58 service nova] Creating event network-changed:2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165 for instance b5984777-9057-4cd8-ac06-cce6636dc4a7 on hv-cinder-85236 Aug 09 17:00:50.657823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-77bb9288-3227-41cf-bf90-d3d15ca769d8 req-c46e3bf6-dce5-4f8c-9a84-12babf9c1b58 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054813 Aug 09 17:00:50.657823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 622/1255] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:00:50.671826 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:50.672599 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:50.685545 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:50.686116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:50.688729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:50.688729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:50.688729 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:50.690422 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:50.863902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:50.877636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b124a7dc-a305-42e9-99a7-f13ea238ce80 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.207200 Aug 09 17:00:50.877636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 634/1256] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:50 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:51.898490 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:51.899238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:51.905298 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:51.905787 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:51.906243 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:51.906922 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:51.907585 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:51.908042 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:52.081245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:52.090866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e6ac4dc0-2911-4fba-994b-962a580d02c1 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.197440 Aug 09 17:00:52.096885 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 623/1257] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:51 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:53.114263 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:53.114915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:53.121411 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:53.121891 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:53.122330 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:53.123290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:53.123497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:53.123922 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:53.290532 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:53.298449 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-76e28995-1be7-44cc-8d96-37f736caf16c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.188959 Aug 09 17:00:53.299046 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 635/1258] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:53 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:54.319208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:54.319824 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:54.322220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:54.327306 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:54.330480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:54.330480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:54.330480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:54.330480 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:54.330829 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:54.497858 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:54.505515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6064e76e-f5ed-483c-a017-7879d42d7f7f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.190659 Aug 09 17:00:54.506086 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 624/1259] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:54 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:55.527236 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:55.527957 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:55.530436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell0:SELECT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:55.536202 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:55.536678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:55.537110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:55.540693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:55.540693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:55.540693 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:55.686123 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:55.709464 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-b62d6571-3a79-4210-b4d0-eb051c9d7b6f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.186432 Aug 09 17:00:55.710072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 636/1260] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:55 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:56.730037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:56.730607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:56.732946 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell0:SELECT=8 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:56.737756 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:56.739180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:56.739752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:56.740504 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:56.740912 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:56.741336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:57.154656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:57.162762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2a0cb45a-e9a6-4d7a-8fd7-b14f7beb2360 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.436681 Aug 09 17:00:57.168980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 625/1261] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:56 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:58.187597 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:58.188215 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:58.195495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:58.195980 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:58.196417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:58.197107 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:58.197555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:58.198002 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:58.336417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:58.343873 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7dc324f4-5f2d-42c8-a3bc-8026e6e349c8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.160161 Aug 09 17:00:58.344442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 637/1262] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:58 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:00:59.365552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:00:59.366172 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:00:59.372325 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:59.372803 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:59.373230 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:59.374050 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:00:59.374495 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:00:59.374915 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:00:59.377621 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:00:59.512389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:00:59.519980 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8bf8179b-ce96-43d3-aebb-9caf4c6474fd tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.159178 Aug 09 17:00:59.520552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 626/1263] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:00:59 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:00.540557 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:00.541228 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:00.547622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:00.548110 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:00.548551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:00.549248 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:00.549734 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:00.550169 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:00.554347 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=97 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:01:00.688505 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:00.696101 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4881fb65-1104-43a4-947e-bd7124e01ac2 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.159432 Aug 09 17:01:00.696678 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 638/1264] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:00 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:01.717809 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:01.718425 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:01.725686 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:01.726164 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:01.726600 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:01.727322 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:01.727771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:01.728193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:01.864256 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:01.871758 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e37a0ce3-6e6b-4aaa-b2b6-06159e9e721c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.158393 Aug 09 17:01:01.872388 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 627/1265] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:01 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:02.892495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:02.893111 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:02.900296 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:02.900782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:02.901250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:02.901973 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:02.902582 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:02.903010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:03.038724 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:03.046413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e6bf4f51-1a03-4913-a530-8f78bf3fbe82 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.157834 Aug 09 17:01:03.046988 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 639/1266] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:02 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:03.592006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-17f9281c-6887-4a68-8af1-e18703c61025 req-3719df64-fc28-444d-8028-85d5192c398e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "name": "network-vif-plugged", "status": "completed", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:01:03.602245 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-17f9281c-6887-4a68-8af1-e18703c61025 req-3719df64-fc28-444d-8028-85d5192c398e service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:03.602713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-17f9281c-6887-4a68-8af1-e18703c61025 req-3719df64-fc28-444d-8028-85d5192c398e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:03.603155 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-17f9281c-6887-4a68-8af1-e18703c61025 req-3719df64-fc28-444d-8028-85d5192c398e service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:03.614740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-17f9281c-6887-4a68-8af1-e18703c61025 req-3719df64-fc28-444d-8028-85d5192c398e service nova] Creating event network-vif-plugged:2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165 for instance b5984777-9057-4cd8-ac06-cce6636dc4a7 on hv-cinder-85236 Aug 09 17:01:03.619799 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-17f9281c-6887-4a68-8af1-e18703c61025 req-3719df64-fc28-444d-8028-85d5192c398e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031494 Aug 09 17:01:03.620394 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 628/1267] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:04.068297 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:04.069010 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:04.075771 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:04.076358 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:04.077055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:04.077978 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:04.078507 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:04.079004 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:04.220639 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:04.229660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-08f9b9c1-a94a-4a7b-8c2d-01ebce169f50 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.165375 Aug 09 17:01:04.230651 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 640/1268] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:04 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:05.251939 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:05.252643 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:05.259146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:05.259638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:05.260069 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:05.260772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:05.261220 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:05.261636 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:05.396099 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:05.403771 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-25e73420-eca0-4c95-a4bf-6490d5eb9d6d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1260 microversion: 2.1 time: 0.156567 Aug 09 17:01:05.404431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 629/1269] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:05 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:06.424743 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:06.426095 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:06.432713 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:06.433201 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:06.433642 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:06.434339 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:06.434796 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:06.435266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:06.569290 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:06.577216 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-9daef9ef-5a6b-441c-a92c-72254b1bf675 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1443 microversion: 2.1 time: 0.156340 Aug 09 17:01:06.577878 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 641/1270] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:06 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:06.597546 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:06.601647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:06.604434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:06.604914 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:06.605408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:06.606161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:06.606618 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:06.607043 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:06.746709 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:06.760632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-6cdf5831-83ec-436b-8e40-1aee7173f829 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1443 microversion: 2.1 time: 0.165669 Aug 09 17:01:06.760632 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 630/1271] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:06 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:09.074000 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-0b4828f0-f2f8-4f30-918c-1799d674a774 req-785f3085-25a1-440c-900f-763c071224b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:01:09.079586 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:01:09.084749 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-0b4828f0-f2f8-4f30-918c-1799d674a774 req-785f3085-25a1-440c-900f-763c071224b8 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:09.085226 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-0b4828f0-f2f8-4f30-918c-1799d674a774 req-785f3085-25a1-440c-900f-763c071224b8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:09.085662 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-0b4828f0-f2f8-4f30-918c-1799d674a774 req-785f3085-25a1-440c-900f-763c071224b8 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:09.096797 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-0b4828f0-f2f8-4f30-918c-1799d674a774 req-785f3085-25a1-440c-900f-763c071224b8 service nova] Creating event network-changed:2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165 for instance b5984777-9057-4cd8-ac06-cce6636dc4a7 on hv-cinder-85236 Aug 09 17:01:09.102068 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-0b4828f0-f2f8-4f30-918c-1799d674a774 req-785f3085-25a1-440c-900f-763c071224b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031948 Aug 09 17:01:09.102750 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 642/1272] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:01:17.211786 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:17.212317 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:17.214825 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:01:17.215500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=25 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:01:17.220551 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:17.221036 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:17.221461 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:17.222174 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:17.223487 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:17.223852 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:17.252222 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:01:17.454102 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-d0b8bece-4805-4e7f-80b8-ac173c4381c5 req-79956da6-5da2-45b1-9c6e-4861d1a90992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d6d438-7e26-4e3d-a088-ca3312a4d746", "tag": "764f036a-2fe6-4b66-9ae3-77f17f6b705f"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:01:17.465417 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d0b8bece-4805-4e7f-80b8-ac173c4381c5 req-79956da6-5da2-45b1-9c6e-4861d1a90992 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:17.465952 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d0b8bece-4805-4e7f-80b8-ac173c4381c5 req-79956da6-5da2-45b1-9c6e-4861d1a90992 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:17.466395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-d0b8bece-4805-4e7f-80b8-ac173c4381c5 req-79956da6-5da2-45b1-9c6e-4861d1a90992 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:17.479234 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-d0b8bece-4805-4e7f-80b8-ac173c4381c5 req-79956da6-5da2-45b1-9c6e-4861d1a90992 service nova] Creating event network-changed:764f036a-2fe6-4b66-9ae3-77f17f6b705f for instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 on hv-cinder-85236 Aug 09 17:01:17.484595 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-d0b8bece-4805-4e7f-80b8-ac173c4381c5 req-79956da6-5da2-45b1-9c6e-4861d1a90992 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273775 Aug 09 17:01:17.488239 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 643/1273] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:17.566734 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-634b6f84-02a6-46f8-a052-07798cd362ba tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 204 len: 0 microversion: 2.1 time: 0.358077 Aug 09 17:01:17.570556 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 631/1274] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 17:01:17 2022] DELETE /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:01:17.576873 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:17.577575 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:17.589483 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:17.590167 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:17.590813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:17.591754 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:17.592433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:17.593016 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:17.752194 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:17.761116 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-75841756-52e4-4a2e-8e17-2e77aa636c44 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1578 microversion: 2.1 time: 0.189077 Aug 09 17:01:17.761702 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 644/1275] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:17 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:18.787548 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:18.788251 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:18.797173 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:18.797651 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:18.798208 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:18.798903 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:18.799373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:18.799791 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:18.944138 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:18.954660 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e704606b-0f26-48f5-954a-6640cd0a47c5 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1578 microversion: 2.1 time: 0.171526 Aug 09 17:01:18.967507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 632/1276] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:18 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:19.976674 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:19.977295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:19.983855 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:19.984636 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:19.985137 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:19.985886 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:19.986506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:19.986927 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:20.148007 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:20.156109 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-c4f88765-0f15-4f02-b8e0-48ccc054ce14 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1459 microversion: 2.1 time: 0.183388 Aug 09 17:01:20.156692 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 645/1277] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:19 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1459 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:20.175943 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-86539c48-8610-4f3b-bc14-cc857109814d req-1d176b83-d7b2-4e73-bfa4-bda2e9662b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d6d438-7e26-4e3d-a088-ca3312a4d746", "name": "network-vif-deleted", "tag": "764f036a-2fe6-4b66-9ae3-77f17f6b705f"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:01:20.185673 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-86539c48-8610-4f3b-bc14-cc857109814d req-1d176b83-d7b2-4e73-bfa4-bda2e9662b68 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:20.186238 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-86539c48-8610-4f3b-bc14-cc857109814d req-1d176b83-d7b2-4e73-bfa4-bda2e9662b68 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:20.186668 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-86539c48-8610-4f3b-bc14-cc857109814d req-1d176b83-d7b2-4e73-bfa4-bda2e9662b68 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:20.200960 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-86539c48-8610-4f3b-bc14-cc857109814d req-1d176b83-d7b2-4e73-bfa4-bda2e9662b68 service nova] Creating event network-vif-deleted:764f036a-2fe6-4b66-9ae3-77f17f6b705f for instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 on hv-cinder-85236 Aug 09 17:01:20.205775 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-86539c48-8610-4f3b-bc14-cc857109814d req-1d176b83-d7b2-4e73-bfa4-bda2e9662b68 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034151 Aug 09 17:01:20.206378 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 633/1278] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:21.177763 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:21.178374 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:21.184781 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:21.185260 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:21.185694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:21.186391 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:21.186848 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:21.187300 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:21.218148 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:21.218614 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:21.219045 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:21.219519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lazy-loading 'fault' on Instance uuid d7d6d438-7e26-4e3d-a088-ca3312a4d746 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:01:21.263302 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:21.271514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-878cca0c-25dc-4a52-b164-e5388fb09cf4 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 200 len: 1230 microversion: 2.1 time: 0.097557 Aug 09 17:01:21.272083 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 646/1279] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:21 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:22.293795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:22.294545 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d7d6d438-7e26-4e3d-a088-ca3312a4d746] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:22.300788 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:22.301275 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:22.301736 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:22.302457 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:22.302919 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:22.303381 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:22.317389 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] HTTP exception thrown: Instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 could not be found. Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Request method failure captured: Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 HTTP/1.1 Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pCz-K1d3REQuzRimtPCwcU1YZ4NE2ud_SAfPJnEFclyJ7Q2JKjgiwzz-a9VEqkrCs0O1JYG0jlW5f0gOzskuri0knSsS3BWCAubqcWSgGfLk8_bu4TmUTPHJUGQIxYY4UUxQzv91tFj27JgkSKCschAQz3osL1VOT3BKQFMsD4H8QU Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:01:22.325296 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5e7f48ecafa4bfe80fadd50e0b24cbb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}] Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 02b21bed2f2d4e58b3759349331d44c7 Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 could not be found. Aug 09 17:01:22.327134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'd7d6d438-7e26-4e3d-a088-ca3312a4d746'} Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 could not be found. Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:01:22.328283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 could not be found. Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 could not be found. Aug 09 17:01:22.330017 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:22.332432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Returning 404 to user: Instance d7d6d438-7e26-4e3d-a088-ca3312a4d746 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:01:22.332432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-b1dbcd32-31c2-4f12-bf32-8bb0c93a6627 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746" status: 404 len: 111 microversion: 2.1 time: 0.031512 Aug 09 17:01:22.332432 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 634/1280] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:22 2022] GET /compute/v2.1/servers/d7d6d438-7e26-4e3d-a088-ca3312a4d746 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:01:25.855425 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:25.856096 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-9922104c-b423-4204-b155-a05daea4cb9d req-109fb181-4930-46d1-934b-b609d44de107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2daaa8cc-0b52-422c-adaa-98f905bb869b", "tag": "de1305b9-b3fe-416b-8157-bf1c65b0aa2a"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:01:25.856883 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:25.864896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:25.865643 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:25.866270 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:25.866405 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-9922104c-b423-4204-b155-a05daea4cb9d req-109fb181-4930-46d1-934b-b609d44de107 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:25.866877 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-9922104c-b423-4204-b155-a05daea4cb9d req-109fb181-4930-46d1-934b-b609d44de107 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:25.867365 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-9922104c-b423-4204-b155-a05daea4cb9d req-109fb181-4930-46d1-934b-b609d44de107 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:25.867667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:25.868282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:25.868874 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:25.879718 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-9922104c-b423-4204-b155-a05daea4cb9d req-109fb181-4930-46d1-934b-b609d44de107 service nova] Creating event network-changed:de1305b9-b3fe-416b-8157-bf1c65b0aa2a for instance 2daaa8cc-0b52-422c-adaa-98f905bb869b on hv-cinder-85236 Aug 09 17:01:25.887533 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-9922104c-b423-4204-b155-a05daea4cb9d req-109fb181-4930-46d1-934b-b609d44de107 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034890 Aug 09 17:01:25.892221 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 635/1281] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:25.901839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Going to try to terminate instance {{(pid=124900) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:01:26.251268 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-dd36902f-a22e-43e3-acdb-5d203bbc6307 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 204 len: 0 microversion: 2.1 time: 0.400383 Aug 09 17:01:26.251870 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 647/1282] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 17:01:25 2022] DELETE /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:01:26.261126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:26.262214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:26.268814 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:26.269418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:26.269949 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:26.270647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:26.271232 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:26.271659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:26.410740 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:26.418430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-7008f68c-6686-463d-8b39-a1d544f41e46 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1576 microversion: 2.1 time: 0.161433 Aug 09 17:01:26.419077 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 636/1283] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:26 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:27.442975 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:27.443725 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:27.450611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:27.451088 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:27.457518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:27.457518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:27.457518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:27.457518 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:27.588185 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:27.595675 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f8128630-bb8e-4e67-9aad-bbed65c1a475 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1576 microversion: 2.1 time: 0.159343 Aug 09 17:01:27.596247 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 648/1284] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:27 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:28.617689 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:28.618506 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:28.624835 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:28.625327 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:28.625769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:28.626471 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:28.626927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:28.627386 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:28.701211 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:28.709739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-84803c20-cf00-490e-a193-b4f15603ecde tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1390 microversion: 2.1 time: 0.096026 Aug 09 17:01:28.710321 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 637/1285] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:28 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:28.802254 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-1225a0d1-64f0-41c6-b549-4d2b5a4aea44 req-b6e333ea-bcba-43d9-99a5-5176d51f29a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2daaa8cc-0b52-422c-adaa-98f905bb869b", "name": "network-vif-deleted", "tag": "de1305b9-b3fe-416b-8157-bf1c65b0aa2a"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:01:28.812392 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-1225a0d1-64f0-41c6-b549-4d2b5a4aea44 req-b6e333ea-bcba-43d9-99a5-5176d51f29a1 service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:28.812867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-1225a0d1-64f0-41c6-b549-4d2b5a4aea44 req-b6e333ea-bcba-43d9-99a5-5176d51f29a1 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:28.813299 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-1225a0d1-64f0-41c6-b549-4d2b5a4aea44 req-b6e333ea-bcba-43d9-99a5-5176d51f29a1 service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:28.824315 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-1225a0d1-64f0-41c6-b549-4d2b5a4aea44 req-b6e333ea-bcba-43d9-99a5-5176d51f29a1 service nova] Creating event network-vif-deleted:de1305b9-b3fe-416b-8157-bf1c65b0aa2a for instance 2daaa8cc-0b52-422c-adaa-98f905bb869b on hv-cinder-85236 Aug 09 17:01:28.829344 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-1225a0d1-64f0-41c6-b549-4d2b5a4aea44 req-b6e333ea-bcba-43d9-99a5-5176d51f29a1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031501 Aug 09 17:01:28.829885 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 649/1286] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:01:29.731634 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:29.732273 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:29.738743 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:29.739302 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:29.739772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:29.740613 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:29.741072 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:29.741499 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:29.772349 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:29.772849 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:29.773285 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:29.773731 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.objects.instance [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lazy-loading 'fault' on Instance uuid 2daaa8cc-0b52-422c-adaa-98f905bb869b {{(pid=124901) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:01:29.814839 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02b21bed2f2d4e58b3759349331d44c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e7f48ecafa4bfe80fadd50e0b24cbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:01:29.822706 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-85a02e71-005e-44f2-a93b-3d88a1faa2f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 200 len: 1229 microversion: 2.1 time: 0.095096 Aug 09 17:01:29.823500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 638/1287] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:29 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:01:30.845629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:30.846388 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: 2daaa8cc-0b52-422c-adaa-98f905bb869b] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:30.853943 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:30.854458 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:30.854896 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:30.855622 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:30.856085 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:30.856514 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:30.859158 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:01:30.870937 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] HTTP exception thrown: Instance 2daaa8cc-0b52-422c-adaa-98f905bb869b could not be found. Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Request method failure captured: Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b HTTP/1.1 Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pCz-K1d3REQuzRimtPCwcU1YZ4NE2ud_SAfPJnEFclyJ7Q2JKjgiwzz-a9VEqkrCs0O1JYG0jlW5f0gOzskuri0knSsS3BWCAubqcWSgGfLk8_bu4TmUTPHJUGQIxYY4UUxQzv91tFj27JgkSKCschAQz3osL1VOT3BKQFMsD4H8QU Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 17:01:30.872650 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5e7f48ecafa4bfe80fadd50e0b24cbb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}] Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 02b21bed2f2d4e58b3759349331d44c7 Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance 2daaa8cc-0b52-422c-adaa-98f905bb869b could not be found. Aug 09 17:01:30.874312 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': '2daaa8cc-0b52-422c-adaa-98f905bb869b'} Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2daaa8cc-0b52-422c-adaa-98f905bb869b could not be found. Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:01:30.875475 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2daaa8cc-0b52-422c-adaa-98f905bb869b could not be found. Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2daaa8cc-0b52-422c-adaa-98f905bb869b could not be found. Aug 09 17:01:30.877129 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:30.878881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Returning 404 to user: Instance 2daaa8cc-0b52-422c-adaa-98f905bb869b could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:01:30.878881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e47fb829-6fb2-4ba9-971f-605c36595448 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b" status: 404 len: 111 microversion: 2.1 time: 0.033178 Aug 09 17:01:30.878881 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 650/1288] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:30 2022] GET /compute/v2.1/servers/2daaa8cc-0b52-422c-adaa-98f905bb869b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:01:31.463431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:31.463431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:31.467883 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:31.468371 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:31.468818 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:31.469555 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:31.470013 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:31.470440 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:31.485063 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] HTTP exception thrown: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Request method failure captured: Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: DELETE /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 HTTP/1.1 Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pCz-K1d3REQuzRimtPCwcU1YZ4NE2ud_SAfPJnEFclyJ7Q2JKjgiwzz-a9VEqkrCs0O1JYG0jlW5f0gOzskuri0knSsS3BWCAubqcWSgGfLk8_bu4TmUTPHJUGQIxYY4UUxQzv91tFj27JgkSKCschAQz3osL1VOT3BKQFMsD4H8QU Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:01:31.487134 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5e7f48ecafa4bfe80fadd50e0b24cbb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}] Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 02b21bed2f2d4e58b3759349331d44c7 Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.488747 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'd6dea3ef-6792-4471-ba10-60009659c637'} Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:01:31.489646 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.492142 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.493595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Returning 404 to user: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:01:31.493595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fccaadeb-698f-4874-81c4-361a0a22f894 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 404 len: 111 microversion: 2.1 time: 0.037049 Aug 09 17:01:31.493595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 639/1289] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 17:01:31 2022] DELETE /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:01:31.501829 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:31.502455 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] [instance: d6dea3ef-6792-4471-ba10-60009659c637] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:01:31.509720 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:31.510207 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:31.510647 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:31.511372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:01:31.511831 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:01:31.512266 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:01:31.526356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.wsgi [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] HTTP exception thrown: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Request method failure captured: Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: request: GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 HTTP/1.1 Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept: application/json Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Accept-Encoding: identity Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Connection: close Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Length: 0 Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Content-Type: application/json Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Host: 10.222.0.59 Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Openstack-System-Scope: None Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: User-Agent: python-urllib3/1.26.11 Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Auth-Token: gAAAAABi8pCz-K1d3REQuzRimtPCwcU1YZ4NE2ud_SAfPJnEFclyJ7Q2JKjgiwzz-a9VEqkrCs0O1JYG0jlW5f0gOzskuri0knSsS3BWCAubqcWSgGfLk8_bu4TmUTPHJUGQIxYY4UUxQzv91tFj27JgkSKCschAQz3osL1VOT3BKQFMsD4H8QU Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Id: None Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Domain-Name: None Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Identity-Status: Confirmed Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Is-Admin-Project: True Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Id: default Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Domain-Name: Default Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Project-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Role: member,reader Aug 09 17:01:31.527902 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Roles: member,reader Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e5e7f48ecafa4bfe80fadd50e0b24cbb", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e5e7f48ecafa4bfe80fadd50e0b24cbb"}]}] Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Id: e5e7f48ecafa4bfe80fadd50e0b24cbb Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-Tenant-Name: tempest-TestVolumeBootPattern-1954653577 Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Id: default Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Domain-Name: Default Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Id: 02b21bed2f2d4e58b3759349331d44c7 Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: X-User-Name: tempest-TestVolumeBootPattern-1954653577-project Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: method: > Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: exception: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.529504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: action_args: {'id': 'd6dea3ef-6792-4471-ba10-60009659c637'} Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:01:31.530856 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. Aug 09 17:01:31.538387 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: ERROR nova.api.openstack.wsgi Aug 09 17:01:31.539746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Returning 404 to user: Instance d6dea3ef-6792-4471-ba10-60009659c637 could not be found. {{(pid=124900) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:01:31.539746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e410c25b-bc49-4462-87f1-19c1681c9afc tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637" status: 404 len: 111 microversion: 2.1 time: 0.031490 Aug 09 17:01:31.539746 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 651/1290] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:01:31 2022] GET /compute/v2.1/servers/d6dea3ef-6792-4471-ba10-60009659c637 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 17:01:33.110176 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-4a8a0dea-7e2a-4213-a1c1-15de2c84a4f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] Calling method '.version_select at 0x7fccc4b04ca0>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:01:33.223458 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-4a8a0dea-7e2a-4213-a1c1-15de2c84a4f0 tempest-TestVolumeBootPattern-1954653577 tempest-TestVolumeBootPattern-1954653577-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-983199229" status: 202 len: 0 microversion: 2.1 time: 0.116985 Aug 09 17:01:33.224584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 640/1291] 10.222.0.59 () {58 vars in 1260 bytes} [Tue Aug 9 17:01:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-983199229 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:03:07.372589 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:07.376908 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:07.377436 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:07.384611 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:07.387356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:07.387356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:07.387356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:07.387356 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:07.387775 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:07.411494 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.objects.instance [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lazy-loading 'flavor' on Instance uuid b5984777-9057-4cd8-ac06-cce6636dc4a7 {{(pid=124900) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 17:03:07.740503 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-640cd21a-ae21-41e6-8d34-9aa01d05b287 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "POST /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7/action" status: 202 len: 0 microversion: 2.1 time: 0.369709 Aug 09 17:03:07.741072 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 652/1292] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 17:03:07 2022] POST /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:03:07.747728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:07.748517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:07.754500 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:07.756102 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:07.762144 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:07.769483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:07.769483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:07.769483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:07.769483 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:07.769934 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:07.908891 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:07.917068 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-dc84374c-2dc0-4a1e-914d-28b09d50d685 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.171376 Aug 09 17:03:07.917644 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 641/1293] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:07 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:08.940309 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:08.941712 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:08.947367 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:08.947876 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:08.948314 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:08.949028 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:08.949506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:08.949997 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:09.093249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:09.101649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-8607a370-30a8-4787-9f7b-6dd796232116 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.166161 Aug 09 17:03:09.102219 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 653/1294] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:08 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:10.123387 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:10.129420 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:10.131654 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:10.132136 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:10.132574 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:10.133265 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:10.133722 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:10.134143 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:10.266607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:10.274764 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-092e6451-741d-43dc-b77e-0a00a7acfef3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.155693 Aug 09 17:03:10.275373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 642/1295] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:10 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:11.296223 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:11.296839 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:11.304205 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:11.304721 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:11.305156 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:11.305852 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:11.306360 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:11.306778 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:11.445143 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:11.452972 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d18edfb5-eba3-4792-9248-4ecbf5301b07 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.160602 Aug 09 17:03:11.453551 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 654/1296] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:11 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:12.474113 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:12.474732 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:12.481469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:12.481953 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:12.482390 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:12.483216 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:12.483686 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:12.484133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:12.630226 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:12.637929 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a5c99687-5179-4110-848e-fa20761005e9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.167967 Aug 09 17:03:12.638507 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 643/1297] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:12 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:13.661378 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:13.672295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:13.672295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:13.672295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:13.672295 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:13.672742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:13.672742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:13.672742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:13.804039 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:13.811915 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e4fa89e1-ddba-492e-8ae4-6e0de22515f3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.155825 Aug 09 17:03:13.812477 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 655/1298] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:13 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:14.834310 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:14.834927 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:14.841410 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:14.841880 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:14.842307 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:14.842986 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:14.843488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:14.843906 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:14.979287 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:14.986714 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-569a00ff-353e-4aab-a5c0-86c62476fea3 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.156865 Aug 09 17:03:14.987344 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 644/1299] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:14 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:16.008563 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:16.009213 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:16.015645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:16.016131 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:16.016572 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:16.017269 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:16.017724 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:16.018154 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:16.152696 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:16.161542 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-05eb0d81-c9fc-4f75-8002-fa9be7817d2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.156861 Aug 09 17:03:16.162125 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 656/1300] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:16 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:17.183423 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:17.184027 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:17.191515 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:17.191790 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:17.192192 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:17.192884 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:17.193336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:17.193760 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:17.325488 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:17.333783 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-99007ab0-dace-4b9f-8aad-2c6319cddc9c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.154371 Aug 09 17:03:17.334357 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 645/1301] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:17 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:18.355457 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:18.356081 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:18.362664 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.363183 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.363631 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.364338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:18.364795 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:18.365224 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:18.500982 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:18.510573 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-55ac0d0a-0122-4c45-9064-44b2b890ef55 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.157687 Aug 09 17:03:18.519766 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 657/1302] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:18 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:19.533133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:19.533752 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:19.541037 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:19.541519 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:19.541951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:19.542638 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:19.543089 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:19.543534 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:19.679283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:19.686772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-58e8aa26-a993-46d8-bd73-73acba5e20c4 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.157493 Aug 09 17:03:19.687370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 646/1303] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:19 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:20.709054 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:20.709707 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:20.716092 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:20.716558 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:20.716994 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:20.717680 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:20.718128 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:20.718544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:20.859055 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:20.866990 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f7ae51b2-3bff-4f68-809c-6aa9bf9d8252 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.162800 Aug 09 17:03:20.868526 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 658/1304] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:20 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:21.888538 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:21.889180 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:21.895684 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.896167 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.896607 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:21.897320 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:21.897770 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:21.898193 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.031627 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:22.039094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-733435f4-5885-4c77-a8df-a360e3eb4879 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1569 microversion: 2.1 time: 0.154414 Aug 09 17:03:22.039707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 647/1305] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:21 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:22.059905 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:22.060506 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:22.067762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.068249 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.068704 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.069403 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.069858 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.070284 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.204735 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124900) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 17:03:22.675171 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-3e55ee3f-de15-40d5-b466-b954587665da tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "POST /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7/action" status: 202 len: 0 microversion: 2.1 time: 0.618999 Aug 09 17:03:22.675864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 659/1306] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 9 17:03:22 2022] POST /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:03:22.684656 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:22.685430 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:22.691584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.692073 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.692505 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.693205 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:22.693655 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:22.694080 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:22.837921 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:22.845907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-12ff7f67-db23-4224-90ab-2eb5f77a0e35 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1517 microversion: 2.1 time: 0.165823 Aug 09 17:03:22.846508 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 648/1307] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:22 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:23.866962 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:23.867627 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:23.873530 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.874017 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.874462 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:23.875179 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:23.881555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:23.881555 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:24.010427 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:24.017904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-e88b3e05-7fba-4253-9aee-9806aeb2f3a9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1517 microversion: 2.1 time: 0.156023 Aug 09 17:03:24.018655 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 660/1308] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:23 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:24.317029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-08b725b4-9bea-4a71-b286-47e9a7406215 req-62824d60-fcba-451a-929d-1dae39cc476a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "name": "network-vif-unplugged", "status": "completed", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:24.326066 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-08b725b4-9bea-4a71-b286-47e9a7406215 req-62824d60-fcba-451a-929d-1dae39cc476a service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:24.326795 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-08b725b4-9bea-4a71-b286-47e9a7406215 req-62824d60-fcba-451a-929d-1dae39cc476a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:24.327241 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-08b725b4-9bea-4a71-b286-47e9a7406215 req-62824d60-fcba-451a-929d-1dae39cc476a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:24.339210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.compute.server_external_events [req-08b725b4-9bea-4a71-b286-47e9a7406215 req-62824d60-fcba-451a-929d-1dae39cc476a service nova] Unable to find a host for instance b5984777-9057-4cd8-ac06-cce6636dc4a7. Dropping event network-vif-unplugged {{(pid=124901) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 17:03:24.340649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-08b725b4-9bea-4a71-b286-47e9a7406215 req-62824d60-fcba-451a-929d-1dae39cc476a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086578 Aug 09 17:03:24.340649 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 649/1309] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 17:03:25.040372 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:25.041214 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:25.047736 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:25.048250 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:25.048670 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:25.049380 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:25.050777 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:25.051238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:25.187895 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:25.196498 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-fadbf8fc-ec30-416d-ac65-cbebed68f875 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1519 microversion: 2.1 time: 0.160676 Aug 09 17:03:25.197338 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 661/1310] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:25 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:26.225575 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:26.226210 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:26.232823 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:26.233300 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:26.233728 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:26.234418 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:26.234866 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:26.235312 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:26.468444 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:26.477662 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-fafcc57a-14d1-49da-9214-3a3d229723e0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.257012 Aug 09 17:03:26.478213 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 650/1311] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:26 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:27.501033 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:27.501649 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:27.509645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.510124 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.510591 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.511333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:27.511782 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:27.512204 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:27.656807 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:27.664823 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-4e5e4c5a-0033-4ba9-a889-ef053c7bc6c9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.167706 Aug 09 17:03:27.665413 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 662/1312] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:27 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:28.685807 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:28.686415 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:28.693448 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:28.693984 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:28.694414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:28.695094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:28.695566 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:28.695987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:28.829347 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:28.837938 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-9dbff748-479b-4b9e-a2b1-3b8a5658d28e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.155999 Aug 09 17:03:28.838520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 651/1313] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:28 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:29.859087 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:29.859694 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:29.866770 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:29.867293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:29.867725 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:29.868419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:29.868865 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:29.869285 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:30.000864 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:30.009333 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f68aef04-4830-4766-96c0-bbf1d1f83f1d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.154190 Aug 09 17:03:30.009912 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 663/1314] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:29 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:31.031431 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:31.032057 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:31.039214 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:31.039700 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:31.040133 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:31.040832 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:31.041283 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:31.041702 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:31.179053 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:31.186532 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-1c8ffc66-a50d-42a6-b5df-61f461660366 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.159023 Aug 09 17:03:31.187126 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 652/1315] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:31 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:32.215463 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:32.216321 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:32.223504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:32.223992 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:32.224529 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:32.225238 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:32.225689 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:32.226115 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:32.376294 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:32.384961 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-82273b4f-4fb8-4d78-84cf-0f1d5b5465c0 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.173555 Aug 09 17:03:32.385537 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 664/1316] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:32 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:33.406071 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:33.406707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:33.413497 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:33.413979 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:33.414416 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:33.415130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:33.415595 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:33.416016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:33.550772 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:33.558414 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-8853c7b4-eb75-47a8-bcb1-47de71d40f60 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.156241 Aug 09 17:03:33.558999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 653/1317] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:33 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:34.580056 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:34.580660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:34.588080 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:34.588566 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:34.589003 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:34.589769 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:34.590222 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:34.590645 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:34.593439 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:34.726519 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:34.734552 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f427721b-fc4c-4c43-93d9-b5206081adad tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.158543 Aug 09 17:03:34.735159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 665/1318] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:34 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:35.756049 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:35.756754 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:35.763391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:35.763871 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:35.764301 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:35.764987 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:35.765434 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:35.765850 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:35.905383 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:35.913945 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-5ad61ed7-29a6-4be6-b7df-201274c7d52c tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.161937 Aug 09 17:03:35.914529 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 654/1319] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:35 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:36.935419 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:36.936184 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:36.944998 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:36.945495 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:36.946206 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:36.947124 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:36.947660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:36.948098 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:37.093904 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:37.102882 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-2d6ff368-1fd3-4734-ab47-6ddaa9377f86 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.171431 Aug 09 17:03:37.103496 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 666/1320] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:36 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:38.124746 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:38.125361 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:38.132094 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:38.132569 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:38.132997 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:38.133713 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:38.134160 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:38.134576 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:38.283680 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:38.292628 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-a1f8ab0b-a621-42cb-82eb-c157a5044424 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.171695 Aug 09 17:03:38.293247 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 655/1321] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:38 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 17:03:38.378935 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-27237160-2e01-42b0-82d0-e3e7029e27ee req-cac73961-b370-44e7-be36-c1d143a4b35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "name": "network-vif-plugged", "status": "completed", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:03:38.384779 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:03:38.390075 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-27237160-2e01-42b0-82d0-e3e7029e27ee req-cac73961-b370-44e7-be36-c1d143a4b35a service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:38.390544 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-27237160-2e01-42b0-82d0-e3e7029e27ee req-cac73961-b370-44e7-be36-c1d143a4b35a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:38.390966 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-27237160-2e01-42b0-82d0-e3e7029e27ee req-cac73961-b370-44e7-be36-c1d143a4b35a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:38.403048 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-27237160-2e01-42b0-82d0-e3e7029e27ee req-cac73961-b370-44e7-be36-c1d143a4b35a service nova] Creating event network-vif-plugged:2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165 for instance b5984777-9057-4cd8-ac06-cce6636dc4a7 on hv-cinder-85236 Aug 09 17:03:38.408197 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-27237160-2e01-42b0-82d0-e3e7029e27ee req-cac73961-b370-44e7-be36-c1d143a4b35a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033683 Aug 09 17:03:38.408816 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 667/1322] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:03:39.313855 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:39.314520 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:39.321854 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:39.322336 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:39.322762 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:39.323568 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:39.323966 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:39.324391 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:39.474268 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:39.482323 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-eefe5035-7861-4452-ab53-2c70a048548e tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1575 microversion: 2.1 time: 0.172261 Aug 09 17:03:39.482999 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 656/1323] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:39 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:40.506043 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:03:40.506756 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:03:40.513660 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:40.514152 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:40.514594 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:40.515336 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:03:40.515799 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:03:40.516233 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:03:40.650032 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:03:40.658456 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-5fc6b4d4-977d-4a9e-8c1c-0883f88f235f tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1562 microversion: 2.1 time: 0.157877 Aug 09 17:03:40.659159 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 668/1324] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:03:40 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:03:57.189629 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:03:57.190328 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Tue Aug 9 17:03:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:04:03.642469 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:04:03.643081 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Tue Aug 9 17:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:04:04.163785 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:04:04.164008 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Tue Aug 9 17:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:04:27.568168 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:04:27.568901 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Tue Aug 9 17:04:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:04:57.951739 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:57.952623 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:57.955847 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [req-54cded01-bc11-4f80-8281-9ed4210206b7 req-c23bd1dd-ac52-4639-a229-9b47ca263c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:04:57.963693 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_api:SELECT=32 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:57.964384 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG dbcounter [-] [124901] Writing DB stats nova_cell1:SELECT=92 {{(pid=124901) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:57.964516 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_api:SELECT=3 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:57.965781 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG dbcounter [-] [124900] Writing DB stats nova_cell1:SELECT=19 {{(pid=124900) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 17:04:57.966269 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.967647 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.968373 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.969130 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.969592 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.970016 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.974058 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-54cded01-bc11-4f80-8281-9ed4210206b7 req-c23bd1dd-ac52-4639-a229-9b47ca263c6a service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:57.975259 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-54cded01-bc11-4f80-8281-9ed4210206b7 req-c23bd1dd-ac52-4639-a229-9b47ca263c6a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:57.975813 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [req-54cded01-bc11-4f80-8281-9ed4210206b7 req-c23bd1dd-ac52-4639-a229-9b47ca263c6a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:57.996613 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.compute.server_external_events [req-54cded01-bc11-4f80-8281-9ed4210206b7 req-c23bd1dd-ac52-4639-a229-9b47ca263c6a service nova] Creating event network-changed:2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165 for instance b5984777-9057-4cd8-ac06-cce6636dc4a7 on hv-cinder-85236 Aug 09 17:04:58.001833 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Going to try to terminate instance {{(pid=124901) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 17:04:58.006861 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [req-54cded01-bc11-4f80-8281-9ed4210206b7 req-c23bd1dd-ac52-4639-a229-9b47ca263c6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056630 Aug 09 17:04:58.007667 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 669/1325] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 17:04:58.386544 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-e938a4ed-5e5e-43ae-9f98-2450d1b16c02 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 204 len: 0 microversion: 2.1 time: 0.439986 Aug 09 17:04:58.387408 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 657/1326] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 9 17:04:57 2022] DELETE /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 17:04:58.399176 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:58.399752 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:58.408910 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:58.413889 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:58.414448 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:58.418862 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:58.419433 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:58.420058 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:58.643490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:58.643490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-7a37f901-61a3-4297-a796-72977250ba2d tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.210904 Aug 09 17:04:58.643490 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 670/1327] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:58 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:04:59.626297 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:04:59.628350 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:04:59.634695 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.635201 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.635637 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.636324 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:04:59.636769 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:04:59.637184 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:04:59.776337 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.policy [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124901) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:04:59.784370 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-c2d59e9c-f700-4e6c-8f7d-1be0fc0dc4f8 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1568 microversion: 2.1 time: 0.162308 Aug 09 17:04:59.784951 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 658/1328] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:04:59 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:00.804770 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:00.805497 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:00.812453 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.813282 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.813951 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.815346 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:00.815981 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:00.816410 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:00.962279 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:00.970504 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-f5ad384f-c2e9-4ad6-964e-aa31808f49b9 tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1449 microversion: 2.1 time: 0.169536 Aug 09 17:05:00.971762 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 671/1329] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:00 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1449 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:01.067001 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [req-6478dd50-9454-4ac9-9c75-b5a0207bf5f5 req-7a77a624-83ed-43ff-8b14-25cc94b8558a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5984777-9057-4cd8-ac06-cce6636dc4a7", "name": "network-vif-deleted", "tag": "2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165"}]} {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 17:05:01.077124 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-6478dd50-9454-4ac9-9c75-b5a0207bf5f5 req-7a77a624-83ed-43ff-8b14-25cc94b8558a service nova] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:01.080672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-6478dd50-9454-4ac9-9c75-b5a0207bf5f5 req-7a77a624-83ed-43ff-8b14-25cc94b8558a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:01.080672 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [req-6478dd50-9454-4ac9-9c75-b5a0207bf5f5 req-7a77a624-83ed-43ff-8b14-25cc94b8558a service nova] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:01.091029 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.compute.server_external_events [req-6478dd50-9454-4ac9-9c75-b5a0207bf5f5 req-7a77a624-83ed-43ff-8b14-25cc94b8558a service nova] Creating event network-vif-deleted:2fc3cf5e-f8f8-41a7-8654-05c3d5ec5165 for instance b5984777-9057-4cd8-ac06-cce6636dc4a7 on hv-cinder-85236 Aug 09 17:05:01.096851 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [req-6478dd50-9454-4ac9-9c75-b5a0207bf5f5 req-7a77a624-83ed-43ff-8b14-25cc94b8558a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033331 Aug 09 17:05:01.097552 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 659/1330] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Aug 9 17:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 17:05:01.995275 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:01.995851 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.compute.api [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124900) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:02.002742 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.003256 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.003695 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.004395 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:02.004849 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:02.005271 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG oslo_concurrency.lockutils [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124900) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:02.082866 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.policy [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '983a58cb49b1410792440784cd84a63c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '907c20a4319c450284e1e6b39107d715', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124900) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 17:05:02.090442 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-d2084874-08dd-4ae7-bf8f-1c773ac2221a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 200 len: 1219 microversion: 2.1 time: 0.099186 Aug 09 17:05:02.094195 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 672/1331] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:01 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 17:05:03.112609 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '>' {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:03.113237 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.compute.api [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] [instance: b5984777-9057-4cd8-ac06-cce6636dc4a7] Fetching instance by UUID {{(pid=124901) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 17:05:03.119659 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.120146 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.120579 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.121282 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Acquiring lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 17:05:03.121735 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 17:05:03.122161 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG oslo_concurrency.lockutils [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Lock "795ddccc-4e3b-400c-a74d-b466147e7ecd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124901) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 17:05:03.136013 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.wsgi [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] HTTP exception thrown: Instance b5984777-9057-4cd8-ac06-cce6636dc4a7 could not be found. Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Request method failure captured: Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: request: GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 HTTP/1.1 Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept: application/json Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Accept-Encoding: identity Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Connection: close Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Length: 0 Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Content-Type: application/json Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Host: 10.222.0.59 Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Openstack-System-Scope: None Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: User-Agent: python-urllib3/1.26.11 Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Auth-Token: gAAAAABi8pKaUQbCqEYRd8drR30xpn1aIp-pVB-umXaOAWMFsF626vSG4p1mzA9Sb28V41IJRMF1fVDuuzy9a0RE1Qet8brM2BfzmPYp9a8uujfAaFL7Jba8Cv4pumIDcu7TQNi5mgcPs3Omd_hGV7VyjNOwCvoLET4-QKuqXcSjUhMnO67eOXY Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Id: None Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Domain-Name: None Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Identity-Status: Confirmed Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Is-Admin-Project: True Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Id: default Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Domain-Name: Default Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Id: 907c20a4319c450284e1e6b39107d715 Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Project-Name: tempest-TestShelveInstance-1899057492 Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Role: member,reader Aug 09 17:05:03.137669 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Roles: member,reader Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/907c20a4319c450284e1e6b39107d715"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/907c20a4319c450284e1e6b39107d715"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_907c20a4319c450284e1e6b39107d715", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/907c20a4319c450284e1e6b39107d715"}]}] Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant: tempest-TestShelveInstance-1899057492 Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Id: 907c20a4319c450284e1e6b39107d715 Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-Tenant-Name: tempest-TestShelveInstance-1899057492 Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User: tempest-TestShelveInstance-1899057492-project Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Id: default Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Domain-Name: Default Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Id: 983a58cb49b1410792440784cd84a63c Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: X-User-Name: tempest-TestShelveInstance-1899057492-project Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: method: > Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: exception: Instance b5984777-9057-4cd8-ac06-cce6636dc4a7 could not be found. Aug 09 17:05:03.139584 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: action_args: {'id': 'b5984777-9057-4cd8-ac06-cce6636dc4a7'} Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: {{(pid=124901) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5984777-9057-4cd8-ac06-cce6636dc4a7 could not be found. Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 17:05:03.140707 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5984777-9057-4cd8-ac06-cce6636dc4a7 could not be found. Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5984777-9057-4cd8-ac06-cce6636dc4a7 could not be found. Aug 09 17:05:03.143006 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: ERROR nova.api.openstack.wsgi Aug 09 17:05:03.144872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: DEBUG nova.api.openstack.wsgi [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Returning 404 to user: Instance b5984777-9057-4cd8-ac06-cce6636dc4a7 could not be found. {{(pid=124901) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 17:05:03.144872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO nova.api.openstack.requestlog [None req-2515f037-be8a-42fe-bffb-a208c92c59ba tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7" status: 404 len: 111 microversion: 2.1 time: 0.031481 Aug 09 17:05:03.144872 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: [pid: 124901|app: 0|req: 660/1332] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 9 17:05:03 2022] GET /compute/v2.1/servers/b5984777-9057-4cd8-ac06-cce6636dc4a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 17:05:03.362218 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: DEBUG nova.api.openstack.wsgi [None req-eecf22d3-4188-4453-badf-8cab0e6ec85a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] Calling method '.version_select at 0x7fccc94fb1f0>' {{(pid=124900) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 17:05:03.475663 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO nova.api.openstack.requestlog [None req-eecf22d3-4188-4453-badf-8cab0e6ec85a tempest-TestShelveInstance-1899057492 tempest-TestShelveInstance-1899057492-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1926711182" status: 202 len: 0 microversion: 2.1 time: 0.117771 Aug 09 17:05:03.476293 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: [pid: 124900|app: 0|req: 673/1333] 10.222.0.59 () {58 vars in 1254 bytes} [Tue Aug 9 17:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1926711182 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 17:05:43.651527 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:05:43.652273 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Tue Aug 9 17:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:07:23.651181 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:07:23.651907 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Tue Aug 9 17:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:07:24.172254 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:07:24.172517 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Tue Aug 9 17:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:07:39.359867 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:07:39.360522 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Tue Aug 9 17:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:07:47.577988 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:07:47.578652 dv-cinder-852364-3-iscsi devstack@n-api.service[124901]: Tue Aug 9 17:07:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:09:03.660044 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:09:03.660760 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Tue Aug 9 17:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 17:10:37.202481 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 17:10:37.203634 dv-cinder-852364-3-iscsi devstack@n-api.service[124900]: Tue Aug 9 17:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!